-- Logs begin at Fri 2022-10-28 19:11:02 UTC, end at Fri 2022-10-28 20:12:29 UTC. -- Oct 28 19:37:54.369036 dv-cinder-862894-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 28 19:37:54.376850 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 19:37:54 2022] *** Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: nodename: dv-cinder-862894-1-iscsi Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: machine: x86_64 Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: clock source: unix Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: pcre jit disabled Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: detected number of CPU cores: 4 Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: current working directory: / Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: detected binary path: /usr/bin/uwsgi-core Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: your processes number limit is 47680 Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: your memory page size is 4096 bytes Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: detected max file descriptor number: 2048 Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: lock engine: pthread robust mutexes Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: thunder lock: enabled Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 28 19:37:54.380433 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 19:37:54.425517 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: Python main interpreter initialized at 0x55fd452889c0 Oct 28 19:37:54.425517 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: python threads support enabled Oct 28 19:37:54.425517 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: your server socket listen backlog is limited to 100 connections Oct 28 19:37:54.425517 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: your mercy for graceful operations on workers is 90 seconds Oct 28 19:37:54.425903 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 19:37:54.425903 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: *** Operational MODE: preforking *** Oct 28 19:37:54.426267 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: *** uWSGI is running in multiple interpreter mode *** Oct 28 19:37:54.426267 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: spawned uWSGI master process (pid: 91676) Oct 28 19:37:54.426448 dv-cinder-862894-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 28 19:37:54.428245 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: spawned uWSGI worker 1 (pid: 91690, cores: 1) Oct 28 19:37:54.428245 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: spawned uWSGI worker 2 (pid: 91691, cores: 1) Oct 28 19:37:54.428245 dv-cinder-862894-1-iscsi devstack@keystone.service[91676]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 19:38:00.158699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:38:00.158699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: from cryptography.utils import int_from_bytes Oct 28 19:38:00.159594 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:38:00.159594 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: from cryptography.utils import int_from_bytes Oct 28 19:38:00.160190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:38:00.160190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: from cryptography.utils import int_from_bytes Oct 28 19:38:00.160671 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:38:00.160671 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: from cryptography.utils import int_from_bytes Oct 28 19:38:00.203864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:38:00.204056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:38:00.204249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] command line args: [] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:38:00.204484 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:38:00.204625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ================================================================================ {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:38:00.204852 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] admin_token = **** {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.205121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] config_dir = [] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.205319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.205416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:38:00.205482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] config_source = [] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.205545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:38:00.205609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] debug = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.205672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] command line args: [] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:38:00.205864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:38:00.208194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ================================================================================ {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:38:00.208331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] admin_token = **** {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208508 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] config_dir = [] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] config_source = [] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208810 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] list_limit = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] debug = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] log_config_append = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.208932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] log_dir = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] log_file = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209445 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209688 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] list_limit = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] log_config_append = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.209952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.210015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.210096 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] log_dir = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.210096 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] log_file = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.210213 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.210285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.210363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.210363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.211234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.211427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.211619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.211844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.212011 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.212203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.212392 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.212392 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.212827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.212987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.213179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.213362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.213546 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.213736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.213736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.214155 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.214346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.214535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] publish_errors = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.214774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.214939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.215123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.215326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.215326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.215752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.215890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.216056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.216185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.216185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] standard_threads = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.216447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.216587 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.216712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] publish_errors = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.216857 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.216989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.217195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.217195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] use_journal = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.217460 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.217590 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] use_json = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.217721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.217859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] use_stderr = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.217993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.218150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] use_syslog = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.218280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.218406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.218589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] standard_threads = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.218724 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.218858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.218990 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.219121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.219262 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.219394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.219530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.219656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] use_journal = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.219656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] use_json = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.219895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.220024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] use_stderr = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.220024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] use_syslog = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.220311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.220535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:38:00.220669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.220793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.220923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.221054 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.221197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.221331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.221456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.221581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.221703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.221827 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.221958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.222108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.222256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.222256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.222493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.222625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.222761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.222902 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.223034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.223164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.223289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.223412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.223614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.223741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.223873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.224007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.224132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.224261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.224400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.224531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.224667 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.224798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.224922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.225046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.225193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.225319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.225444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.225567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.225695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.225826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.225961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.226107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.226239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.226370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.226507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.226636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.226770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.226894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.227018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.227142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.227264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.227393 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.227527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.227653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.227783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.227917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.228047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.228189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.228315 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.228438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.228561 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.228684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.228807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.228938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.229068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.229192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.229321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.229451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.229576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.229777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.229777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.230026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.230180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.230314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.230446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.230617 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.230754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.230880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.231009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.231134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.231257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.231388 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.231518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.231648 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.232844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.233012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.233198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.233418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.233580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.233771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.233956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.234190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.234413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.234618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.234786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.234970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.235154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.235336 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.235594 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.235796 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.236045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.236220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.236405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.236595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.236779 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.236996 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.237157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.237342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.237525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.237708 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.237874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.238058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.238259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.238398 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.238532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.238690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.238818 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.238942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.239074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.239200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.239359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.239493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.239624 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.239750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.239896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.240022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.240152 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.240278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.240410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.240536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.240716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.240865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.240992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.241117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.241241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.241365 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.241495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.241632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.241775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.241905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.242030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.242187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.242316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.242449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.242575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.242575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.242809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.242933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.243072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.243207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.243496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.243637 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.243763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.243894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.244028 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.244153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.244277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.244402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.244526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.244649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.244784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.244909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.245041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.245171 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.245296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.245431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.245629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.245758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.245888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.246014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.246199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.246327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.246462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.246598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.246737 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.246908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.247041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.247172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.247304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.247440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.247573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.247705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.247836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.247964 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.248088 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.248211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.248344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.248470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.248594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.248719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.248851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.248975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.249108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.249244 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] auth.external = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.249368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.249491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.249623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.249755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.249894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.250020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.250167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.250292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] auth.password = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.250416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.250554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] auth.token = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.250687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.250853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.250988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.251145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.251281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.251409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.251568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.251755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.251897 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] auth.external = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.252026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.252155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.252279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.252279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.252515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.252650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] credential.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.252792 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.252920 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.253057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] auth.password = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.253184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.253321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] auth.token = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.253321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.253567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.253567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.253804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.253804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.254049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.254221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.254357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.254485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.254620 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.254746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.254885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.255013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.255137 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.255262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] credential.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.255392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.255518 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.255655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.255781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.255906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.256031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.256157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.256281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.256426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.256553 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.256678 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.256803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.256927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] federation.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.257052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.257185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.257185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.257423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.257549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.257673 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.257797 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.257944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.258098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.258232 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.258374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.258509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.258636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.258770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.258902 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.259029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.259153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.259279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.259404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.259540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] federation.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.259667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.259791 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.259925 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.260141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.260284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.260423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.260550 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.260676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.260840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.260972 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.261105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.261311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.261449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.261575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.261701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.261837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.261963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.262166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.262323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.262458 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.262584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.262584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.262821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.262958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.263085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.263209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.263334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.263459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.263592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.263729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.263862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.263989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.264113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.264238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.264371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.264499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.264631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.264756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.264881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.265008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.265140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.265267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.265406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.265535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.265660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.265784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.265921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.266048 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.266201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.266337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.266464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.266589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.266723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.266850 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.266974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.267115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.267300 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.267447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.267583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.267711 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.267842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.267971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.268096 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.268221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.268354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.268481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.268606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.268731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.268856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.268991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.269124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.269254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.269378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.269503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.269634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.269769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.269769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.270017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.270253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.270391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.270517 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.270642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.270776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.270950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.271081 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.271207 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.271331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.271455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.271589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.271717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.271842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.271973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.272100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.272224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.272357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.272484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.272614 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.272758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.272886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.273012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.273145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.273272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.273397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.273521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.273645 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.273770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.273903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.274139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.274286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.274424 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.274565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.274691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.274823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.275049 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.275195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.275323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.275449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.275573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.275712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.275840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.275971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.276099 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.276223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.276355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.276499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.276626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.276757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.276889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.277058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.277192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.277321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.277446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.277577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.277703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.277834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.278018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.278207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.278338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.278474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.278600 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.278727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.278727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.278978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.278978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.279215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.279215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.279450 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.279587 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.279715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.279839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.279964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.280100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.280225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.280359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.280485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.280615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.280742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.280866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.281026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.281165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.281293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.281419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.281545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.281669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.281794 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.281937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.282064 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.282238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.282378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.282502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.282627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.282793 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.282971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.283110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.283235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.283367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] resource.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.283494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.283626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.283753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.283890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.284015 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.284139 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.284263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.284396 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.284523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.284647 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.284772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.284896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.285020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.285152 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.285279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.285404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.285539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.285664 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.285789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.285921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] role.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.286048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.286197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] role.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.286323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.286447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.286572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.286772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.286901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] resource.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.287027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.287153 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.287278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.287413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.287547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.287675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.287800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.287935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.288061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.288186 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.288318 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.288445 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.288569 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.288694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.288818 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.288942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.289075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.289211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.289336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.289461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] role.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.289585 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.289711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] role.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.289843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.289970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.290137 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.290270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.290395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.290531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.290658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.290784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.290923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.291085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.291216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.291350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.291477 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.291604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.291737 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.291864 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.291988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.292121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.292253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.292380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.292504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.292639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.292765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.292897 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.293024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.293150 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.293628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.293763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.293889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.293889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.294158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.294287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.294427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.294553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.294689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.294823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.294950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.295075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.295199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.295322 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] token.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.295447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.295579 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.295705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.295833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.295959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.296084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.296208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.296341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.296478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.296604 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.296729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.296855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.296991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.297119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.297243 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.297367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.297492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.297616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.297752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.297885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.298014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.298214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.298354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.298538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.298715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.298890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.299035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.299163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.299288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] token.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.299413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.299547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.299675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.299800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.299926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.300051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.300188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.connection = **** {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.300327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.300463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.300599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.300726 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.300851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.300976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.301150 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.301284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.301419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.301546 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.301679 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.301804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.301804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.302145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.302292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.302422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.302547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.302672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.302796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.302930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.303063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.303190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.303323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.303448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.303573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.303697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.303841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.303973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.304106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.304245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.connection = **** {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.304388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.304526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.304653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.304788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.304916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.304916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:38:00.305154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.305154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.305154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.305154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.305154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.305154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.305154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.305154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.305154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.306287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.306287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.306287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.306287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.306287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.306287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.306287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:38:00.306287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:38:00.317537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.317775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.318009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.320454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.320717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.320957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.326736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.329619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.355125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.355367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.356130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.356409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.410716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.411365 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.460117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.460458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.460951 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.461189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.525317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.525610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.525699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.525767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.525829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.525998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.526117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.526187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.526332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.526414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.526544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.526713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.551995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.552253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.552413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.552501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.552634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.552733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.552869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.552948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.553077 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.553209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.553317 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.553383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.553621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.553842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.564477 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.564980 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.577342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.577569 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.577657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.577794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.577876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.578027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.578135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.578285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.578373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.578457 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.578538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.578694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91691) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.578776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.578934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91690) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:38:00.595879 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.596094 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.596183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:38:00.596318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:38:00.596399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.596588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:38:00.596673 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.596835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:38:00.596918 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.597067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.597152 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.597325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.597418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.597574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.597662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.597830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.608116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.608386 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.608646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.608731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.608922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.609007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.609192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.609473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.617001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.617618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.620222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.620498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.620774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.620858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.621050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.621136 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.621325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.621410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.621584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.621665 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.621856 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.622012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.622180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.622275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.622459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.622539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.622700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.622780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.622952 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.623032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.623272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.623540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.648701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.649816 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.650309 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.650597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.651443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.651727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.656213 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.656484 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.656757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.657092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.657374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.657657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.663914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.664151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.664838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.665125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.668948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.669405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.669684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.669943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.670029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.670261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.670352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.670519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.670599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.670766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.670845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.671006 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.671095 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.671309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.671573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.671838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.689440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.689869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.690465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.690748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.694487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.695273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.698150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.698446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.698989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.699285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.703368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.704276 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.707235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.707872 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.711120 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.711486 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.711701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.711801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.712061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.712318 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.712414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.712621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.712899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.713076 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.713468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.713871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.731902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.732190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.732456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.732718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.733400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.733811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.734310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.734739 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.740494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.742364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.742643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.743121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.745115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.745523 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.745754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.746041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.746350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.746636 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.746965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.749469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.749747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.750037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.750383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.750651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.761663 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.761946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.762262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.762580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.762868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.763153 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.763428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.765133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.765408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.765687 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.765966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.766271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.766552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.766827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.781173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.784379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.784530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.787604 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.892780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.894421 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.896063 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.896351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.896610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.899172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.900764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.902396 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.902677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.902960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.904021 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.905608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.909003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.909285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.909566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.909822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.910326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.911869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.915277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.915474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.915760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.916008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.919346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.919634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.919917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.925307 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.925607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.925855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.927816 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91690) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.928101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.928347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.928642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.928860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.929162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.929446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.929723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.929962 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.930306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.930555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.930835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.931075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.931377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91690) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.933663 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91691) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:38:00.933946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.934213 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.934553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.934829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.935079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.935355 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.935594 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.935889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.936127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.936416 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.936641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.936924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.937180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91691) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:38:00.969249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd452889c0 pid: 91690 (default app) Oct 28 19:38:00.972625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fa025-a646-4b4e-84b4-18fed6a71f1c None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:00.972892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fa025-a646-4b4e-84b4-18fed6a71f1c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:00.973200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fa025-a646-4b4e-84b4-18fed6a71f1c None None] PATH_INFO: `/v3` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:00.974459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd452889c0 pid: 91691 (default app) Oct 28 19:38:00.977421 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Fri Oct 28 19:38:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:09.269773 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be67534-af9c-46ce-a49c-666475e88bf5 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:09.270348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be67534-af9c-46ce-a49c-666475e88bf5 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:09.270348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be67534-af9c-46ce-a49c-666475e88bf5 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:09.275589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:09.282039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df341-6a91-4aa3-bd8c-db4102be6fca None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:09.282550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df341-6a91-4aa3-bd8c-db4102be6fca None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:09.282632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df341-6a91-4aa3-bd8c-db4102be6fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:09.314189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7df341-6a91-4aa3-bd8c-db4102be6fca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 19:38:09.495276 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG passlib.handlers.bcrypt [None req-fb7df341-6a91-4aa3-bd8c-db4102be6fca None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91690) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 19:38:09.495695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG passlib.handlers.bcrypt [None req-fb7df341-6a91-4aa3-bd8c-db4102be6fca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91690) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 19:38:09.551713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fb7df341-6a91-4aa3-bd8c-db4102be6fca None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:09.553232 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fb7df341-6a91-4aa3-bd8c-db4102be6fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:09.683172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 19:38:09.845935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be67534-af9c-46ce-a49c-666475e88bf5 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:09.881519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG oslo_db.sqlalchemy.engines [None req-0be67534-af9c-46ce-a49c-666475e88bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 19:38:10.008495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be67534-af9c-46ce-a49c-666475e88bf5 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:10.013273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172fe8d-a3b5-471e-88ff-5f7c5a938ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:10.013942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172fe8d-a3b5-471e-88ff-5f7c5a938ebe admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:10.014258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172fe8d-a3b5-471e-88ff-5f7c5a938ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:10.014506 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172fe8d-a3b5-471e-88ff-5f7c5a938ebe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:10.023274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172fe8d-a3b5-471e-88ff-5f7c5a938ebe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:10.074361 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f172fe8d-a3b5-471e-88ff-5f7c5a938ebe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 19:38:10.074680 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172fe8d-a3b5-471e-88ff-5f7c5a938ebe admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:10.085907 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Oct 28 19:38:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:38:10.092043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df341-6a91-4aa3-bd8c-db4102be6fca None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:10.106872 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df341-6a91-4aa3-bd8c-db4102be6fca None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:10.112717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc87773-5047-40ec-b325-bc01efafc4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:10.113880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc87773-5047-40ec-b325-bc01efafc4af admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:10.114196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc87773-5047-40ec-b325-bc01efafc4af admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:10.114477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc87773-5047-40ec-b325-bc01efafc4af admin admin] PATH_INFO: `/v3/projects/62033cd74f1d4b33b3b42a6bdfc49f3f` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:10.116119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc87773-5047-40ec-b325-bc01efafc4af admin admin] RBAC: Authorizing `identity:get_project(project_id=62033cd74f1d4b33b3b42a6bdfc49f3f)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:10.167994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6bc87773-5047-40ec-b325-bc01efafc4af admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 19:38:10.168325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc87773-5047-40ec-b325-bc01efafc4af admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:10.173469 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Fri Oct 28 19:38:10 2022] GET /identity/v3/projects/62033cd74f1d4b33b3b42a6bdfc49f3f => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:12.463699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b97393-8336-49d5-ac33-477b32d8014e None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:12.464531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b97393-8336-49d5-ac33-477b32d8014e None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:12.464531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b97393-8336-49d5-ac33-477b32d8014e None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:12.471945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:12.478930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b00-6c70-4d58-9c0b-9185527f7a66 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:12.479639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b00-6c70-4d58-9c0b-9185527f7a66 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:12.479814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b00-6c70-4d58-9c0b-9185527f7a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:12.500683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ccda2b00-6c70-4d58-9c0b-9185527f7a66 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:12.502273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ccda2b00-6c70-4d58-9c0b-9185527f7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:12.510580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 19:38:12.532946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b97393-8336-49d5-ac33-477b32d8014e None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:12.549006 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b97393-8336-49d5-ac33-477b32d8014e None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:12.555237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966a3ba-6730-4201-9730-ab94ce107b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:12.555878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966a3ba-6730-4201-9730-ab94ce107b88 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:12.556163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966a3ba-6730-4201-9730-ab94ce107b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:12.556440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966a3ba-6730-4201-9730-ab94ce107b88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:12.565175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966a3ba-6730-4201-9730-ab94ce107b88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:12.567011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966a3ba-6730-4201-9730-ab94ce107b88 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:12.576702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Oct 28 19:38:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:38:12.582980 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2b00-6c70-4d58-9c0b-9185527f7a66 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:12.597370 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2b00-6c70-4d58-9c0b-9185527f7a66 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:12.606422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16574f45-14c4-4c20-93ff-69f66d0252f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:12.607604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16574f45-14c4-4c20-93ff-69f66d0252f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:12.607889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16574f45-14c4-4c20-93ff-69f66d0252f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:12.608164 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16574f45-14c4-4c20-93ff-69f66d0252f2 admin admin] PATH_INFO: `/v3/users/90024dc2520a490e92255f559b6d8bd9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:12.609710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16574f45-14c4-4c20-93ff-69f66d0252f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=90024dc2520a490e92255f559b6d8bd9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:12.611638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16574f45-14c4-4c20-93ff-69f66d0252f2 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:12.613199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Fri Oct 28 19:38:12 2022] GET /identity/v3/users/90024dc2520a490e92255f559b6d8bd9 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:14.973250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ed708-f711-4c9e-9881-e1637028e8e2 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:14.973755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ed708-f711-4c9e-9881-e1637028e8e2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:14.973755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ed708-f711-4c9e-9881-e1637028e8e2 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:14.975732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:14.980799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b2b70-1db9-486d-bed7-c343d6cfb368 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:14.981207 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b2b70-1db9-486d-bed7-c343d6cfb368 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:14.981358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b2b70-1db9-486d-bed7-c343d6cfb368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:14.999061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f95b2b70-1db9-486d-bed7-c343d6cfb368 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:15.000251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f95b2b70-1db9-486d-bed7-c343d6cfb368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:15.012889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b0d66-2cf7-4d07-a0f7-4c688d68a3cd None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:15.013176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b0d66-2cf7-4d07-a0f7-4c688d68a3cd None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:15.013497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b0d66-2cf7-4d07-a0f7-4c688d68a3cd None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:15.015312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:38:15.020032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae540177-3640-4d5b-842e-48855f51382a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:15.020414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae540177-3640-4d5b-842e-48855f51382a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:15.020694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae540177-3640-4d5b-842e-48855f51382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:15.061776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG passlib.handlers.bcrypt [None req-ae540177-3640-4d5b-842e-48855f51382a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91691) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 19:38:15.062285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG passlib.handlers.bcrypt [None req-ae540177-3640-4d5b-842e-48855f51382a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91691) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 19:38:15.080372 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:15.103560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b2b70-1db9-486d-bed7-c343d6cfb368 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:15.108296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ae540177-3640-4d5b-842e-48855f51382a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:15.109922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ae540177-3640-4d5b-842e-48855f51382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:15.197703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b2b70-1db9-486d-bed7-c343d6cfb368 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:15.210486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:38:15.231059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66368-ff82-425f-b32c-e10c2d7bc9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:15.231824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66368-ff82-425f-b32c-e10c2d7bc9e6 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:15.232102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66368-ff82-425f-b32c-e10c2d7bc9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:15.232327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae540177-3640-4d5b-842e-48855f51382a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:15.232457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66368-ff82-425f-b32c-e10c2d7bc9e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:15.243479 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb66368-ff82-425f-b32c-e10c2d7bc9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:15.250483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-3eb66368-ff82-425f-b32c-e10c2d7bc9e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:38:15.251699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:38:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:15.257624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66368-ff82-425f-b32c-e10c2d7bc9e6 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:15.331044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae540177-3640-4d5b-842e-48855f51382a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:15.356299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66368-ff82-425f-b32c-e10c2d7bc9e6 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:15.365894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d79fda-d711-4f8e-a468-1300e0675dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:15.366821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d79fda-d711-4f8e-a468-1300e0675dde None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:15.367103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d79fda-d711-4f8e-a468-1300e0675dde None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:15.367379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d79fda-d711-4f8e-a468-1300e0675dde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:15.389967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6493a0-d5cf-48df-8f1f-d184ef5be4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:15.390663 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6493a0-d5cf-48df-8f1f-d184ef5be4c4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:15.390941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6493a0-d5cf-48df-8f1f-d184ef5be4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:15.391216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6493a0-d5cf-48df-8f1f-d184ef5be4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:15.391975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6493a0-d5cf-48df-8f1f-d184ef5be4c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:15.392272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6493a0-d5cf-48df-8f1f-d184ef5be4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:15.393671 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6493a0-d5cf-48df-8f1f-d184ef5be4c4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:15.404441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:15.410529 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6493a0-d5cf-48df-8f1f-d184ef5be4c4 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:15.434409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d79fda-d711-4f8e-a468-1300e0675dde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:15.435998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d79fda-d711-4f8e-a468-1300e0675dde None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:15.506488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6493a0-d5cf-48df-8f1f-d184ef5be4c4 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:15.532201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:15.537718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4666d-9a46-472e-a9e8-4b34d6ae46ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:15.538203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d79fda-d711-4f8e-a468-1300e0675dde None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:15.538641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4666d-9a46-472e-a9e8-4b34d6ae46ff None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:15.538923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4666d-9a46-472e-a9e8-4b34d6ae46ff None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:15.539196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4666d-9a46-472e-a9e8-4b34d6ae46ff None admin] PATH_INFO: `/v3/users/90024dc2520a490e92255f559b6d8bd9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:15.540552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4666d-9a46-472e-a9e8-4b34d6ae46ff None admin] RBAC: Authorizing `identity:get_user(user_id=90024dc2520a490e92255f559b6d8bd9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:15.542097 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4666d-9a46-472e-a9e8-4b34d6ae46ff None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:15.543736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:15 2022] GET /identity/v3/users/90024dc2520a490e92255f559b6d8bd9 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:15.549427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4666d-9a46-472e-a9e8-4b34d6ae46ff None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:15.636068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d79fda-d711-4f8e-a468-1300e0675dde None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:15.647271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4666d-9a46-472e-a9e8-4b34d6ae46ff None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:15.675426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7a18-0614-4452-a5a0-5afb96654958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:15.676250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7a18-0614-4452-a5a0-5afb96654958 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:15.676532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7a18-0614-4452-a5a0-5afb96654958 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:15.676806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7a18-0614-4452-a5a0-5afb96654958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:15.681955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd152-0a0c-42ff-acd7-04471efb6dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:15.682797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd152-0a0c-42ff-acd7-04471efb6dc6 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:15.683079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd152-0a0c-42ff-acd7-04471efb6dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:15.683349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd152-0a0c-42ff-acd7-04471efb6dc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:15.684661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bd152-0a0c-42ff-acd7-04471efb6dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:15.686345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bd152-0a0c-42ff-acd7-04471efb6dc6 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:15.687963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:15.693843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd152-0a0c-42ff-acd7-04471efb6dc6 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:15.695531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7a18-0614-4452-a5a0-5afb96654958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:15.697008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7a18-0614-4452-a5a0-5afb96654958 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:15.713875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-71ec7a18-0614-4452-a5a0-5afb96654958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:38:15.715119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:38:15.720993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7a18-0614-4452-a5a0-5afb96654958 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:15.789638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd152-0a0c-42ff-acd7-04471efb6dc6 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:15.815958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7a18-0614-4452-a5a0-5afb96654958 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:15.824671 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00877b-6da3-4716-9908-c3e5debf0b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:15.825337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00877b-6da3-4716-9908-c3e5debf0b1d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:15.825631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00877b-6da3-4716-9908-c3e5debf0b1d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:15.825938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00877b-6da3-4716-9908-c3e5debf0b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:15.826849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00877b-6da3-4716-9908-c3e5debf0b1d None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.domain.id=default, user.id=90024dc2520a490e92255f559b6d8bd9) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:15.827210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00877b-6da3-4716-9908-c3e5debf0b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:15.828633 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00877b-6da3-4716-9908-c3e5debf0b1d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:15.835470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Oct 28 19:38:15 2022] GET /identity/v3/role_assignments?user.id=90024dc2520a490e92255f559b6d8bd9&scope.domain.id=default&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:15.848655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f5511-1a57-481e-8815-15cfc4598b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:15.849356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f5511-1a57-481e-8815-15cfc4598b02 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:15.849637 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f5511-1a57-481e-8815-15cfc4598b02 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:15.849912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f5511-1a57-481e-8815-15cfc4598b02 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:15.850696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f5511-1a57-481e-8815-15cfc4598b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:15.851004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f5511-1a57-481e-8815-15cfc4598b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:15.852462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f5511-1a57-481e-8815-15cfc4598b02 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:15.874580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:18.500793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66e269-5c4f-496a-97c8-5fe5b89638d7 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:18.501785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66e269-5c4f-496a-97c8-5fe5b89638d7 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:18.502304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66e269-5c4f-496a-97c8-5fe5b89638d7 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:18.504746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:18.510422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8b36-5760-4332-b5e7-e20b738d36b9 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:18.510822 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8b36-5760-4332-b5e7-e20b738d36b9 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:18.510981 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8b36-5760-4332-b5e7-e20b738d36b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:18.531727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-01cf8b36-5760-4332-b5e7-e20b738d36b9 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:18.533167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-01cf8b36-5760-4332-b5e7-e20b738d36b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:18.616588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:18.653577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66e269-5c4f-496a-97c8-5fe5b89638d7 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:18.786841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66e269-5c4f-496a-97c8-5fe5b89638d7 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:18.825618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d2b9d-938c-4e00-8bfb-a07c37b5f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:18.826798 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d2b9d-938c-4e00-8bfb-a07c37b5f619 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:18.827241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d2b9d-938c-4e00-8bfb-a07c37b5f619 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:18.827675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d2b9d-938c-4e00-8bfb-a07c37b5f619 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:18.850997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d2b9d-938c-4e00-8bfb-a07c37b5f619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:18.858370 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-d57d2b9d-938c-4e00-8bfb-a07c37b5f619 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:38:18.860115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 13/24] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:38:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:18.866138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf8b36-5760-4332-b5e7-e20b738d36b9 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:18.976589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf8b36-5760-4332-b5e7-e20b738d36b9 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:19.000916 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5614-2df7-46be-b352-6f712de60942 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.001481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5614-2df7-46be-b352-6f712de60942 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.001901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5614-2df7-46be-b352-6f712de60942 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.003986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 14/25] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:38:19.010139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac92f9-adaf-40f2-b927-dc4b4bad09ab None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.010753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac92f9-adaf-40f2-b927-dc4b4bad09ab None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.011414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac92f9-adaf-40f2-b927-dc4b4bad09ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.025254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b12aca-5d02-4a74-8b6b-d6b8ca9ef1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:19.026452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12aca-5d02-4a74-8b6b-d6b8ca9ef1c2 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.026944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12aca-5d02-4a74-8b6b-d6b8ca9ef1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.027411 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12aca-5d02-4a74-8b6b-d6b8ca9ef1c2 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.028415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b12aca-5d02-4a74-8b6b-d6b8ca9ef1c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:19.030848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b12aca-5d02-4a74-8b6b-d6b8ca9ef1c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:19.032940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b12aca-5d02-4a74-8b6b-d6b8ca9ef1c2 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:19.041201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d0ac92f9-adaf-40f2-b927-dc4b4bad09ab None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:19.046377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d0ac92f9-adaf-40f2-b927-dc4b4bad09ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:19.064201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 12/26] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:19.070822 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b12aca-5d02-4a74-8b6b-d6b8ca9ef1c2 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:19.199553 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 15/27] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:19.233238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac92f9-adaf-40f2-b927-dc4b4bad09ab None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:19.283144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b12aca-5d02-4a74-8b6b-d6b8ca9ef1c2 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:19.370473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac92f9-adaf-40f2-b927-dc4b4bad09ab None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:19.370819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f189d-5dde-47e1-af19-2a9cf8dbb1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:19.371736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f189d-5dde-47e1-af19-2a9cf8dbb1da None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.372016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f189d-5dde-47e1-af19-2a9cf8dbb1da None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.372292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f189d-5dde-47e1-af19-2a9cf8dbb1da None admin] PATH_INFO: `/v3/users/90024dc2520a490e92255f559b6d8bd9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.373979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f189d-5dde-47e1-af19-2a9cf8dbb1da None admin] RBAC: Authorizing `identity:get_user(user_id=90024dc2520a490e92255f559b6d8bd9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:19.378943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f189d-5dde-47e1-af19-2a9cf8dbb1da None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:19.381013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 13/28] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:19 2022] GET /identity/v3/users/90024dc2520a490e92255f559b6d8bd9 => generated 247 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:19.382367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6ba5-4b8e-4869-add2-5f2d43027f70 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.382650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6ba5-4b8e-4869-add2-5f2d43027f70 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.382927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6ba5-4b8e-4869-add2-5f2d43027f70 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.384762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 14/29] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:19.390173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91da265-581d-4084-8fe7-332f2865c2ff None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.390463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91da265-581d-4084-8fe7-332f2865c2ff None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.390736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91da265-581d-4084-8fe7-332f2865c2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.413983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d90b8-99d1-4681-bca2-577ecb7abfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:19.414702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d90b8-99d1-4681-bca2-577ecb7abfbd None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.414984 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d90b8-99d1-4681-bca2-577ecb7abfbd None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.415258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d90b8-99d1-4681-bca2-577ecb7abfbd None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.416029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d90b8-99d1-4681-bca2-577ecb7abfbd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:19.417444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d90b8-99d1-4681-bca2-577ecb7abfbd None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:19.426208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c91da265-581d-4084-8fe7-332f2865c2ff None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:19.427650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c91da265-581d-4084-8fe7-332f2865c2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:19.497654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 15/30] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:38:19.498619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91da265-581d-4084-8fe7-332f2865c2ff None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:19.582815 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 16/31] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Oct 28 19:38:19 2022] POST /identity/v3/roles => generated 225 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:38:19.585742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d1cfa-05e9-4e7c-86b0-f5d49cd89543 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.586275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d1cfa-05e9-4e7c-86b0-f5d49cd89543 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.586693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d1cfa-05e9-4e7c-86b0-f5d49cd89543 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.594243 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 17/32] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:19.595312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d1cfa-05e9-4e7c-86b0-f5d49cd89543 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:19.632571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91da265-581d-4084-8fe7-332f2865c2ff None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:19.723715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d1cfa-05e9-4e7c-86b0-f5d49cd89543 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:19.758874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401ec17-2829-4fca-91d8-1e8e0a75666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:19.759960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401ec17-2829-4fca-91d8-1e8e0a75666c None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.764099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401ec17-2829-4fca-91d8-1e8e0a75666c None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.764099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401ec17-2829-4fca-91d8-1e8e0a75666c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.766570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401ec17-2829-4fca-91d8-1e8e0a75666c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:19.768077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401ec17-2829-4fca-91d8-1e8e0a75666c None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:19.768861 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77c9d-68de-4fdf-8697-5c05253b914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:19.769945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77c9d-68de-4fdf-8697-5c05253b914f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.770390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77c9d-68de-4fdf-8697-5c05253b914f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.770831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77c9d-68de-4fdf-8697-5c05253b914f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.778527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 16/33] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:19.780299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d8d4c-e8c4-4c93-b2f5-029e68d5ee68 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.780438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d8d4c-e8c4-4c93-b2f5-029e68d5ee68 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.780649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d8d4c-e8c4-4c93-b2f5-029e68d5ee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:19.784622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d77c9d-68de-4fdf-8697-5c05253b914f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:19.786705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d77c9d-68de-4fdf-8697-5c05253b914f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:19.807952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-b0d77c9d-68de-4fdf-8697-5c05253b914f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:38:19.810074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 18/34] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:19.811159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77c9d-68de-4fdf-8697-5c05253b914f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:19.816751 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-6c8d8d4c-e8c4-4c93-b2f5-029e68d5ee68 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:19.818063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6c8d8d4c-e8c4-4c93-b2f5-029e68d5ee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:19.932651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 17/35] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:19.933428 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d8d4c-e8c4-4c93-b2f5-029e68d5ee68 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:19.945059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77c9d-68de-4fdf-8697-5c05253b914f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:19.994238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef66c1-04a3-41fc-91cc-addaf444be70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:19.995358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef66c1-04a3-41fc-91cc-addaf444be70 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:19.995799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef66c1-04a3-41fc-91cc-addaf444be70 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:19.996239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef66c1-04a3-41fc-91cc-addaf444be70 None admin] PATH_INFO: `/v3/domains/default/users/90024dc2520a490e92255f559b6d8bd9/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.001008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef66c1-04a3-41fc-91cc-addaf444be70 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=90024dc2520a490e92255f559b6d8bd9, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:20.002732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef66c1-04a3-41fc-91cc-addaf444be70 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:20.021541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 19/36] 10.222.0.20 () {58 vars in 1361 bytes} [Fri Oct 28 19:38:19 2022] PUT /identity/v3/domains/default/users/90024dc2520a490e92255f559b6d8bd9/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:38:20.026114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef66c1-04a3-41fc-91cc-addaf444be70 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:20.060522 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d8d4c-e8c4-4c93-b2f5-029e68d5ee68 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:20.099105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7986f-957f-4b46-885e-ab66f737f328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:20.099974 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7986f-957f-4b46-885e-ab66f737f328 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:20.100366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7986f-957f-4b46-885e-ab66f737f328 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:20.100713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7986f-957f-4b46-885e-ab66f737f328 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.101528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7986f-957f-4b46-885e-ab66f737f328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:20.101899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7986f-957f-4b46-885e-ab66f737f328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:20.103445 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7986f-957f-4b46-885e-ab66f737f328 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:20.118176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 18/37] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:20.120009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dee3b6-7e86-44cd-9674-4ae23339f0f6 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:20.120382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dee3b6-7e86-44cd-9674-4ae23339f0f6 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:20.120742 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dee3b6-7e86-44cd-9674-4ae23339f0f6 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.126126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 19/38] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:20.127282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dee3b6-7e86-44cd-9674-4ae23339f0f6 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:20.163854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef66c1-04a3-41fc-91cc-addaf444be70 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:20.200703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91535cc2-690a-443c-ac4b-30255239fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:20.201423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91535cc2-690a-443c-ac4b-30255239fcf4 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:20.201710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91535cc2-690a-443c-ac4b-30255239fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:20.201990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91535cc2-690a-443c-ac4b-30255239fcf4 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.202871 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91535cc2-690a-443c-ac4b-30255239fcf4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:20.204304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91535cc2-690a-443c-ac4b-30255239fcf4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:20.220775 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Oct 28 19:38:20 2022] POST /identity/v3/roles => generated 219 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:20.224408 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3df92e-64d8-4450-b472-2b6b88234a4b None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:20.224697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3df92e-64d8-4450-b472-2b6b88234a4b None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:20.224982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3df92e-64d8-4450-b472-2b6b88234a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.243921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dee3b6-7e86-44cd-9674-4ae23339f0f6 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:20.256553 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ff3df92e-64d8-4450-b472-2b6b88234a4b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:20.258852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ff3df92e-64d8-4450-b472-2b6b88234a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:20.289358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca8b6b-5a86-4fb5-9163-ce2360ea6cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:20.290103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca8b6b-5a86-4fb5-9163-ce2360ea6cff None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:20.290401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca8b6b-5a86-4fb5-9163-ce2360ea6cff None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:20.290680 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca8b6b-5a86-4fb5-9163-ce2360ea6cff None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.291422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca8b6b-5a86-4fb5-9163-ce2360ea6cff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:20.292970 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca8b6b-5a86-4fb5-9163-ce2360ea6cff None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:20.342331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 21/40] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:20.344289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4e396-0e48-4eb0-9c2c-be05f53fef04 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:20.344787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4e396-0e48-4eb0-9c2c-be05f53fef04 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:20.345254 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4e396-0e48-4eb0-9c2c-be05f53fef04 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.347387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 22/41] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:20.355846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b572b-bb14-4087-aa0b-824bf085e966 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:20.356173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b572b-bb14-4087-aa0b-824bf085e966 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:20.356452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b572b-bb14-4087-aa0b-824bf085e966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.378272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-916b572b-bb14-4087-aa0b-824bf085e966 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:20.379751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-916b572b-bb14-4087-aa0b-824bf085e966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:20.451598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 20/42] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:38:20 2022] POST /identity/v3/projects => generated 301 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:20.453259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca8b6b-5a86-4fb5-9163-ce2360ea6cff None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:20.453576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 23/43] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:20.487575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b572b-bb14-4087-aa0b-824bf085e966 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:20.594753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca8b6b-5a86-4fb5-9163-ce2360ea6cff None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:20.608608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b572b-bb14-4087-aa0b-824bf085e966 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:20.634168 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c7888-0181-4c90-8f35-86a61c1fe00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:20.635615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7888-0181-4c90-8f35-86a61c1fe00f None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:20.636138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7888-0181-4c90-8f35-86a61c1fe00f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:20.636638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7888-0181-4c90-8f35-86a61c1fe00f None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.637606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c7888-0181-4c90-8f35-86a61c1fe00f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:20.639528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c7888-0181-4c90-8f35-86a61c1fe00f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:20.653811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586d2d3-a3e9-441e-905e-6f3d1bc140df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:20.657768 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586d2d3-a3e9-441e-905e-6f3d1bc140df None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:20.658666 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586d2d3-a3e9-441e-905e-6f3d1bc140df None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:20.658956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586d2d3-a3e9-441e-905e-6f3d1bc140df None admin] PATH_INFO: `/v3/domains/default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.660585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586d2d3-a3e9-441e-905e-6f3d1bc140df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:20.662260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586d2d3-a3e9-441e-905e-6f3d1bc140df None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:20.664220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 21/44] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Oct 28 19:38:20 2022] POST /identity/v3/roles => generated 223 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:20.666112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 24/45] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:20.670927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c7888-0181-4c90-8f35-86a61c1fe00f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:20.783783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c7888-0181-4c90-8f35-86a61c1fe00f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:20.818914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0366fc-e932-4812-aa77-e31716514b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:20.819611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0366fc-e932-4812-aa77-e31716514b97 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:20.819895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0366fc-e932-4812-aa77-e31716514b97 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:20.820167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0366fc-e932-4812-aa77-e31716514b97 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:20.820897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0366fc-e932-4812-aa77-e31716514b97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:20.822467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0366fc-e932-4812-aa77-e31716514b97 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:20.851674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 22/46] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:38:20 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:22.510198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5184e0-9f51-45c7-9d4c-f6bade4f1d39 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:22.510735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5184e0-9f51-45c7-9d4c-f6bade4f1d39 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:22.510735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5184e0-9f51-45c7-9d4c-f6bade4f1d39 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:22.512690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 25/47] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:22.517933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9bd62-8d08-4733-8234-75b5c6fd3972 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:22.518389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9bd62-8d08-4733-8234-75b5c6fd3972 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:22.518498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9bd62-8d08-4733-8234-75b5c6fd3972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:22.536835 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-59d9bd62-8d08-4733-8234-75b5c6fd3972 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:22.538403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-59d9bd62-8d08-4733-8234-75b5c6fd3972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:22.605550 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:22.628836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5184e0-9f51-45c7-9d4c-f6bade4f1d39 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:22.731916 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5184e0-9f51-45c7-9d4c-f6bade4f1d39 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:22.764492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7627-6aa2-4908-bb9a-8487f0a39527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:22.765230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7627-6aa2-4908-bb9a-8487f0a39527 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:22.765512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7627-6aa2-4908-bb9a-8487f0a39527 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:22.765785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7627-6aa2-4908-bb9a-8487f0a39527 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:22.776047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b7627-6aa2-4908-bb9a-8487f0a39527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:22.783450 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-6e3b7627-6aa2-4908-bb9a-8487f0a39527 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:38:22.784651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 26/49] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:38:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:22.790665 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9bd62-8d08-4733-8234-75b5c6fd3972 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:22.893776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9bd62-8d08-4733-8234-75b5c6fd3972 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:22.927581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e0727-354a-4e4e-b78e-3c75720c6759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:22.928256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e0727-354a-4e4e-b78e-3c75720c6759 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:22.928540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e0727-354a-4e4e-b78e-3c75720c6759 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:22.928816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e0727-354a-4e4e-b78e-3c75720c6759 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:22.929574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e0727-354a-4e4e-b78e-3c75720c6759 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:22.929881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e0727-354a-4e4e-b78e-3c75720c6759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:22.931319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e0727-354a-4e4e-b78e-3c75720c6759 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:22.939786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 24/50] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:22.945680 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7627-6aa2-4908-bb9a-8487f0a39527 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:23.044334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7627-6aa2-4908-bb9a-8487f0a39527 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:23.080024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096ac26-2d7c-465f-a23e-cac312ab8c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:23.080905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ac26-2d7c-465f-a23e-cac312ab8c08 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:23.081189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ac26-2d7c-465f-a23e-cac312ab8c08 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:23.081461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ac26-2d7c-465f-a23e-cac312ab8c08 None admin] PATH_INFO: `/v3/users/90024dc2520a490e92255f559b6d8bd9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:23.082667 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096ac26-2d7c-465f-a23e-cac312ab8c08 None admin] RBAC: Authorizing `identity:get_user(user_id=90024dc2520a490e92255f559b6d8bd9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:23.084131 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096ac26-2d7c-465f-a23e-cac312ab8c08 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:23.085785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 27/51] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:22 2022] GET /identity/v3/users/90024dc2520a490e92255f559b6d8bd9 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:23.091420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e0727-354a-4e4e-b78e-3c75720c6759 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:23.180349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1219b96-98cb-4c5d-8c39-c01450a1fc72 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:23.180750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1219b96-98cb-4c5d-8c39-c01450a1fc72 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:23.181034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1219b96-98cb-4c5d-8c39-c01450a1fc72 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:23.182881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 28/52] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:23.187960 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d533-4f16-4135-abf2-e3b6a3f8eb5c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:23.188247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d533-4f16-4135-abf2-e3b6a3f8eb5c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:23.188527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d533-4f16-4135-abf2-e3b6a3f8eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:23.192266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e0727-354a-4e4e-b78e-3c75720c6759 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:23.205533 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-52a6d533-4f16-4135-abf2-e3b6a3f8eb5c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:23.206741 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-52a6d533-4f16-4135-abf2-e3b6a3f8eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:23.226122 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0896e2-c361-4951-a9d8-07b11579eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:23.226940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0896e2-c361-4951-a9d8-07b11579eb1b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:23.227229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0896e2-c361-4951-a9d8-07b11579eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:23.227508 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0896e2-c361-4951-a9d8-07b11579eb1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:23.228716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0896e2-c361-4951-a9d8-07b11579eb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:23.230233 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0896e2-c361-4951-a9d8-07b11579eb1b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:23.231945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 25/53] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:23.237968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0896e2-c361-4951-a9d8-07b11579eb1b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:23.271817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 29/54] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:23.295834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d533-4f16-4135-abf2-e3b6a3f8eb5c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:23.331740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0896e2-c361-4951-a9d8-07b11579eb1b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:23.364242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee01410-7b7f-4817-b59a-957284664a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:23.364901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01410-7b7f-4817-b59a-957284664a3d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:23.365178 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01410-7b7f-4817-b59a-957284664a3d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:23.365448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01410-7b7f-4817-b59a-957284664a3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:23.366302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01410-7b7f-4817-b59a-957284664a3d None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.domain.id=default, user.id=90024dc2520a490e92255f559b6d8bd9) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:23.366609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01410-7b7f-4817-b59a-957284664a3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:23.368043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01410-7b7f-4817-b59a-957284664a3d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:23.377144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 26/55] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Oct 28 19:38:23 2022] GET /identity/v3/role_assignments?user.id=90024dc2520a490e92255f559b6d8bd9&scope.domain.id=default&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:23.391305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d533-4f16-4135-abf2-e3b6a3f8eb5c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:23.428257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021084-6c71-4ccf-8aa6-98bfc046b56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:23.429080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021084-6c71-4ccf-8aa6-98bfc046b56c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:23.429363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021084-6c71-4ccf-8aa6-98bfc046b56c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:23.429640 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021084-6c71-4ccf-8aa6-98bfc046b56c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:23.430902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8021084-6c71-4ccf-8aa6-98bfc046b56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:23.432393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8021084-6c71-4ccf-8aa6-98bfc046b56c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:23.434143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 30/56] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:23.440790 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee01410-7b7f-4817-b59a-957284664a3d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:23.552176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee01410-7b7f-4817-b59a-957284664a3d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:23.588219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24742f27-7603-43ba-b89e-400f22e8581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:23.588904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24742f27-7603-43ba-b89e-400f22e8581e None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:23.589191 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24742f27-7603-43ba-b89e-400f22e8581e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:23.589463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24742f27-7603-43ba-b89e-400f22e8581e None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:23.590212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24742f27-7603-43ba-b89e-400f22e8581e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:23.591677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24742f27-7603-43ba-b89e-400f22e8581e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:23.616885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 27/57] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Oct 28 19:38:23 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:25.947761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751088e9-3cec-4198-855a-34a88815c80e None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:25.948277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751088e9-3cec-4198-855a-34a88815c80e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:25.948277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751088e9-3cec-4198-855a-34a88815c80e None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:25.950022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 31/58] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:25.956617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b9db-b4c9-451e-9791-6f2b05550055 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:25.957311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b9db-b4c9-451e-9791-6f2b05550055 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:25.957582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b9db-b4c9-451e-9791-6f2b05550055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:25.985214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-2b32b9db-b4c9-451e-9791-6f2b05550055 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:25.986509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2b32b9db-b4c9-451e-9791-6f2b05550055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:26.066896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 28/59] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:38:26.095101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751088e9-3cec-4198-855a-34a88815c80e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:26.194536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751088e9-3cec-4198-855a-34a88815c80e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:26.228009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611efaa5-4a23-410a-a6f7-b339ce36fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:26.228733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611efaa5-4a23-410a-a6f7-b339ce36fe5f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:26.229012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611efaa5-4a23-410a-a6f7-b339ce36fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:26.229286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611efaa5-4a23-410a-a6f7-b339ce36fe5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:26.230519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611efaa5-4a23-410a-a6f7-b339ce36fe5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:26.231965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611efaa5-4a23-410a-a6f7-b339ce36fe5f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:26.233631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 32/60] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:26.240080 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b9db-b4c9-451e-9791-6f2b05550055 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:26.353601 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b9db-b4c9-451e-9791-6f2b05550055 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:26.397453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a3ab5-280b-4090-961d-02535ccf6414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:26.398130 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3ab5-280b-4090-961d-02535ccf6414 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:26.398419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3ab5-280b-4090-961d-02535ccf6414 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:26.398694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3ab5-280b-4090-961d-02535ccf6414 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:26.399398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a3ab5-280b-4090-961d-02535ccf6414 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:26.400851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a3ab5-280b-4090-961d-02535ccf6414 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:26.432051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 29/61] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:38:26 2022] POST /identity/v3/users => generated 275 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:29.868806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ce7f-c96d-4d08-9ed6-6986175d2fa9 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:29.869691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ce7f-c96d-4d08-9ed6-6986175d2fa9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:29.870140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ce7f-c96d-4d08-9ed6-6986175d2fa9 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:29.872154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 33/62] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:29.874073 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975d41c-a45f-44cf-9cb0-79afdc718b94 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:29.874871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975d41c-a45f-44cf-9cb0-79afdc718b94 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:29.875359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975d41c-a45f-44cf-9cb0-79afdc718b94 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:29.877301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ef28d-4b70-4bbb-bb41-0193052cab3f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:29.877789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ef28d-4b70-4bbb-bb41-0193052cab3f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:29.878296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ef28d-4b70-4bbb-bb41-0193052cab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:29.891814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 30/63] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:29 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:29.893525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b630b-65d9-430e-8ca7-8df9ee42b05c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:29.894046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b630b-65d9-430e-8ca7-8df9ee42b05c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:29.894555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b630b-65d9-430e-8ca7-8df9ee42b05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:29.907804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-db2ef28d-4b70-4bbb-bb41-0193052cab3f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:29.915164 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-db2ef28d-4b70-4bbb-bb41-0193052cab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:29.923089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-911b630b-65d9-430e-8ca7-8df9ee42b05c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:29.924329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-911b630b-65d9-430e-8ca7-8df9ee42b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:30.017295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 34/64] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:38:30.057758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ef28d-4b70-4bbb-bb41-0193052cab3f None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:30.084196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 31/65] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:30.107898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b630b-65d9-430e-8ca7-8df9ee42b05c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:30.165048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ef28d-4b70-4bbb-bb41-0193052cab3f None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:30.201148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3069c2d-bd0d-441d-9342-86a4ef9ff395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:30.202239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3069c2d-bd0d-441d-9342-86a4ef9ff395 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.202517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3069c2d-bd0d-441d-9342-86a4ef9ff395 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.202787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3069c2d-bd0d-441d-9342-86a4ef9ff395 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.220219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3069c2d-bd0d-441d-9342-86a4ef9ff395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:30.227558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-a3069c2d-bd0d-441d-9342-86a4ef9ff395 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:38:30.229021 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 35/66] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:38:30.239404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3069c2d-bd0d-441d-9342-86a4ef9ff395 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:30.258285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b630b-65d9-430e-8ca7-8df9ee42b05c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:30.296666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c6522-3e7c-4e61-8bec-6c833c8c569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:30.297490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c6522-3e7c-4e61-8bec-6c833c8c569c None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.297778 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c6522-3e7c-4e61-8bec-6c833c8c569c None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.298055 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c6522-3e7c-4e61-8bec-6c833c8c569c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.320789 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c6522-3e7c-4e61-8bec-6c833c8c569c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:30.331786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-960c6522-3e7c-4e61-8bec-6c833c8c569c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:38:30.333047 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 32/67] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:38:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:38:30.335800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015e395-596b-45ec-a95e-de1607f950a7 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.336087 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015e395-596b-45ec-a95e-de1607f950a7 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.336365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015e395-596b-45ec-a95e-de1607f950a7 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.338145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 33/68] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:30.342597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015e395-596b-45ec-a95e-de1607f950a7 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:30.393246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3069c2d-bd0d-441d-9342-86a4ef9ff395 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:30.427314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9e02b-e76f-4029-919d-6dffc158aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:30.427910 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e02b-e76f-4029-919d-6dffc158aea7 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.428195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e02b-e76f-4029-919d-6dffc158aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.428471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e02b-e76f-4029-919d-6dffc158aea7 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.429229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9e02b-e76f-4029-919d-6dffc158aea7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:30.429535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9e02b-e76f-4029-919d-6dffc158aea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:30.430974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9e02b-e76f-4029-919d-6dffc158aea7 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:30.439597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 36/69] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:30.440585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe5c4e-9a88-488a-a936-5c178ffca6b7 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.440871 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe5c4e-9a88-488a-a936-5c178ffca6b7 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.441170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe5c4e-9a88-488a-a936-5c178ffca6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.448227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015e395-596b-45ec-a95e-de1607f950a7 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:30.462643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4efe5c4e-9a88-488a-a936-5c178ffca6b7 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:30.463828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4efe5c4e-9a88-488a-a936-5c178ffca6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:30.481784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded74fe-9d7f-459b-8de6-eac060b15f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:30.482505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded74fe-9d7f-459b-8de6-eac060b15f15 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.482785 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded74fe-9d7f-459b-8de6-eac060b15f15 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.483067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded74fe-9d7f-459b-8de6-eac060b15f15 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.483947 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded74fe-9d7f-459b-8de6-eac060b15f15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:30.484253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded74fe-9d7f-459b-8de6-eac060b15f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:30.485667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded74fe-9d7f-459b-8de6-eac060b15f15 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:30.494143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 34/70] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:30.494962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded74fe-9d7f-459b-8de6-eac060b15f15 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:30.536703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 37/71] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:30.537555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe5c4e-9a88-488a-a936-5c178ffca6b7 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:30.593521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded74fe-9d7f-459b-8de6-eac060b15f15 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:30.625559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fa611-2e37-496e-8324-54aec7ffd4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:30.626538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa611-2e37-496e-8324-54aec7ffd4be None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.626815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa611-2e37-496e-8324-54aec7ffd4be None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.627086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa611-2e37-496e-8324-54aec7ffd4be None admin] PATH_INFO: `/v3/users/693008c321194ab9b799c5831e6413ab` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.642131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fa611-2e37-496e-8324-54aec7ffd4be None admin] RBAC: Authorizing `identity:get_user(user_id=693008c321194ab9b799c5831e6413ab)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:30.643621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fa611-2e37-496e-8324-54aec7ffd4be None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:30.649826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 35/72] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:30 2022] GET /identity/v3/users/693008c321194ab9b799c5831e6413ab => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:30.649826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c43d3c-4b83-48ff-aa19-e3b79ed82e5c None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.649826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c43d3c-4b83-48ff-aa19-e3b79ed82e5c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.649826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c43d3c-4b83-48ff-aa19-e3b79ed82e5c None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.649826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 36/73] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:30.649826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c43d3c-4b83-48ff-aa19-e3b79ed82e5c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:30.656203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe5c4e-9a88-488a-a936-5c178ffca6b7 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:30.690998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925ea9d-aefe-4bc3-8513-be0e5109a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:30.692301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925ea9d-aefe-4bc3-8513-be0e5109a711 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.692587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925ea9d-aefe-4bc3-8513-be0e5109a711 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.692866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925ea9d-aefe-4bc3-8513-be0e5109a711 None admin] PATH_INFO: `/v3/users/90024dc2520a490e92255f559b6d8bd9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.694075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925ea9d-aefe-4bc3-8513-be0e5109a711 None admin] RBAC: Authorizing `identity:get_user(user_id=90024dc2520a490e92255f559b6d8bd9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:30.695553 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925ea9d-aefe-4bc3-8513-be0e5109a711 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:30.701832 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 38/74] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:30 2022] GET /identity/v3/users/90024dc2520a490e92255f559b6d8bd9 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:30.702534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925ea9d-aefe-4bc3-8513-be0e5109a711 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:30.747735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c43d3c-4b83-48ff-aa19-e3b79ed82e5c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:30.781468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7792366-e072-4c7b-8327-26b3d8fa0543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:30.782322 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7792366-e072-4c7b-8327-26b3d8fa0543 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.782610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7792366-e072-4c7b-8327-26b3d8fa0543 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.782883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7792366-e072-4c7b-8327-26b3d8fa0543 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.792501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7792366-e072-4c7b-8327-26b3d8fa0543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:30.794487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925ea9d-aefe-4bc3-8513-be0e5109a711 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:30.800270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a7792366-e072-4c7b-8327-26b3d8fa0543 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:38:30.801583 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:38:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:30.802777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c199e5e-36c4-4abc-9ef7-a7db2f341f04 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.803061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c199e5e-36c4-4abc-9ef7-a7db2f341f04 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.803340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c199e5e-36c4-4abc-9ef7-a7db2f341f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.819243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-9c199e5e-36c4-4abc-9ef7-a7db2f341f04 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:30.820419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9c199e5e-36c4-4abc-9ef7-a7db2f341f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:30.826541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261589f-140f-4a83-b49f-ced83856bfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:30.827214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261589f-140f-4a83-b49f-ced83856bfc4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.827498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261589f-140f-4a83-b49f-ced83856bfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.827765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261589f-140f-4a83-b49f-ced83856bfc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.884298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 38/76] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:30.885145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c199e5e-36c4-4abc-9ef7-a7db2f341f04 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:30.893361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261589f-140f-4a83-b49f-ced83856bfc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:30.895014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261589f-140f-4a83-b49f-ced83856bfc4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:30.981827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c199e5e-36c4-4abc-9ef7-a7db2f341f04 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:30.988888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 39/77] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:30.993719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bd339-c701-42d5-807c-17ef20e2aef9 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:30.993719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bd339-c701-42d5-807c-17ef20e2aef9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:30.993719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bd339-c701-42d5-807c-17ef20e2aef9 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:30.993719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 40/78] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:30.993719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bd339-c701-42d5-807c-17ef20e2aef9 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.017850 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4c5c1-b32d-4281-8e8c-8d241c622433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.018548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4c5c1-b32d-4281-8e8c-8d241c622433 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.018834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4c5c1-b32d-4281-8e8c-8d241c622433 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.019117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4c5c1-b32d-4281-8e8c-8d241c622433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.084021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4c5c1-b32d-4281-8e8c-8d241c622433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:31.085535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4c5c1-b32d-4281-8e8c-8d241c622433 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:31.092236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bd339-c701-42d5-807c-17ef20e2aef9 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:31.125310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c254a-f571-48f9-9fe3-0eeb11c28a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.125988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c254a-f571-48f9-9fe3-0eeb11c28a93 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.126313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c254a-f571-48f9-9fe3-0eeb11c28a93 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.126591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c254a-f571-48f9-9fe3-0eeb11c28a93 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.127346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c254a-f571-48f9-9fe3-0eeb11c28a93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:31.127681 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c254a-f571-48f9-9fe3-0eeb11c28a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:31.129089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c254a-f571-48f9-9fe3-0eeb11c28a93 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:31.136719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 41/79] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:38:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:31.137491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c254a-f571-48f9-9fe3-0eeb11c28a93 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.180545 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 39/80] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:31.181463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4c5c1-b32d-4281-8e8c-8d241c622433 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.234931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c254a-f571-48f9-9fe3-0eeb11c28a93 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:31.267754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dd4e3-9e9b-4832-ae61-7a8d28c5d681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.268554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd4e3-9e9b-4832-ae61-7a8d28c5d681 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.268842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd4e3-9e9b-4832-ae61-7a8d28c5d681 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.269119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd4e3-9e9b-4832-ae61-7a8d28c5d681 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.272551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4c5c1-b32d-4281-8e8c-8d241c622433 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:31.279104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dd4e3-9e9b-4832-ae61-7a8d28c5d681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:31.286132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-b85dd4e3-9e9b-4832-ae61-7a8d28c5d681 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:38:31.287324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 42/81] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:31.289784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb36259-7d26-4cc2-af36-0d41040c2fee None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.290074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb36259-7d26-4cc2-af36-0d41040c2fee None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.290386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb36259-7d26-4cc2-af36-0d41040c2fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.305542 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fb9fc-8155-45cd-9f9e-abd3b66c3cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.306449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fb9fc-8155-45cd-9f9e-abd3b66c3cce None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.306732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fb9fc-8155-45cd-9f9e-abd3b66c3cce None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.307003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fb9fc-8155-45cd-9f9e-abd3b66c3cce None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.308048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2bb36259-7d26-4cc2-af36-0d41040c2fee None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:31.308227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fb9fc-8155-45cd-9f9e-abd3b66c3cce None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:31.309253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2bb36259-7d26-4cc2-af36-0d41040c2fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:31.309679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fb9fc-8155-45cd-9f9e-abd3b66c3cce None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:31.311426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 40/82] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:31 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:31.312176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fb9fc-8155-45cd-9f9e-abd3b66c3cce None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.371694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 43/83] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:31.372799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb36259-7d26-4cc2-af36-0d41040c2fee None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.406584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fb9fc-8155-45cd-9f9e-abd3b66c3cce None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:31.441106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fb1d7-9cc9-453a-b5fe-d8d3b784a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.441989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fb1d7-9cc9-453a-b5fe-d8d3b784a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.442294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fb1d7-9cc9-453a-b5fe-d8d3b784a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.442553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fb1d7-9cc9-453a-b5fe-d8d3b784a6a4 None admin] PATH_INFO: `/v3/users/693008c321194ab9b799c5831e6413ab` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.443781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fb1d7-9cc9-453a-b5fe-d8d3b784a6a4 None admin] RBAC: Authorizing `identity:get_user(user_id=693008c321194ab9b799c5831e6413ab)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:31.445245 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fb1d7-9cc9-453a-b5fe-d8d3b784a6a4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:31.446885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 41/84] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:31 2022] GET /identity/v3/users/693008c321194ab9b799c5831e6413ab => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:31.450695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fb1d7-9cc9-453a-b5fe-d8d3b784a6a4 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.474718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb36259-7d26-4cc2-af36-0d41040c2fee None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:31.507324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ada1bc-f500-4338-a25e-32f4c6e98d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.508208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ada1bc-f500-4338-a25e-32f4c6e98d0a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.508492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ada1bc-f500-4338-a25e-32f4c6e98d0a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.508770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ada1bc-f500-4338-a25e-32f4c6e98d0a None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.510012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ada1bc-f500-4338-a25e-32f4c6e98d0a None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:31.511563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ada1bc-f500-4338-a25e-32f4c6e98d0a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:31.513247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 44/85] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:31 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:31.513999 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ada1bc-f500-4338-a25e-32f4c6e98d0a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.547259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fb1d7-9cc9-453a-b5fe-d8d3b784a6a4 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:31.580052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec44f9-75be-4746-93ab-1b9b0de286dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.580730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec44f9-75be-4746-93ab-1b9b0de286dd None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.581002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec44f9-75be-4746-93ab-1b9b0de286dd None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.581280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec44f9-75be-4746-93ab-1b9b0de286dd None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.582032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec44f9-75be-4746-93ab-1b9b0de286dd None admin] RBAC: Adding query filter params (name=member) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:31.582363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec44f9-75be-4746-93ab-1b9b0de286dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:31.583755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec44f9-75be-4746-93ab-1b9b0de286dd None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:31.591697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 42/86] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:31.592482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec44f9-75be-4746-93ab-1b9b0de286dd None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.608945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ada1bc-f500-4338-a25e-32f4c6e98d0a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:31.644506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855be83a-d4d9-44ab-80fd-9b2bd89b7777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.645160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855be83a-d4d9-44ab-80fd-9b2bd89b7777 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.645440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855be83a-d4d9-44ab-80fd-9b2bd89b7777 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.645712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855be83a-d4d9-44ab-80fd-9b2bd89b7777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.646596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855be83a-d4d9-44ab-80fd-9b2bd89b7777 None admin] RBAC: Adding query filter params (role.id=20d2df2c0f34477d842f0e792557bb47, scope.project.id=1aca8b3a36e4474591361aeac183f0b4, user.id=693008c321194ab9b799c5831e6413ab) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:31.646909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855be83a-d4d9-44ab-80fd-9b2bd89b7777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:31.648379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855be83a-d4d9-44ab-80fd-9b2bd89b7777 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:31.666343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 45/87] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:31 2022] GET /identity/v3/role_assignments?user.id=693008c321194ab9b799c5831e6413ab&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:31.666343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855be83a-d4d9-44ab-80fd-9b2bd89b7777 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.692883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec44f9-75be-4746-93ab-1b9b0de286dd None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:31.727188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e308ca3-398c-47b2-a800-b3470cad5589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.728027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e308ca3-398c-47b2-a800-b3470cad5589 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.728304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e308ca3-398c-47b2-a800-b3470cad5589 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.728577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e308ca3-398c-47b2-a800-b3470cad5589 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.729794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e308ca3-398c-47b2-a800-b3470cad5589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:31.731333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e308ca3-398c-47b2-a800-b3470cad5589 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:31.732984 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 43/88] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:31.738358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e308ca3-398c-47b2-a800-b3470cad5589 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.760792 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855be83a-d4d9-44ab-80fd-9b2bd89b7777 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:31.795199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfab8e-2be5-4c1c-a95f-cc36097fb757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.796279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfab8e-2be5-4c1c-a95f-cc36097fb757 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.796562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfab8e-2be5-4c1c-a95f-cc36097fb757 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.796836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfab8e-2be5-4c1c-a95f-cc36097fb757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.838427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e308ca3-398c-47b2-a800-b3470cad5589 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:31.864174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfab8e-2be5-4c1c-a95f-cc36097fb757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:31.865724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfab8e-2be5-4c1c-a95f-cc36097fb757 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:31.871838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39cfff-0185-4f83-a192-6149b1709944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:31.872515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39cfff-0185-4f83-a192-6149b1709944 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:31.872808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39cfff-0185-4f83-a192-6149b1709944 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:31.873087 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39cfff-0185-4f83-a192-6149b1709944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:31.873959 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39cfff-0185-4f83-a192-6149b1709944 None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=1aca8b3a36e4474591361aeac183f0b4, user.id=90024dc2520a490e92255f559b6d8bd9) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:31.874474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39cfff-0185-4f83-a192-6149b1709944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:31.875944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39cfff-0185-4f83-a192-6149b1709944 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:31.881417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 44/89] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:31 2022] GET /identity/v3/role_assignments?user.id=90024dc2520a490e92255f559b6d8bd9&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:31.881417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39cfff-0185-4f83-a192-6149b1709944 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:31.973079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 46/90] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:31.973785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfab8e-2be5-4c1c-a95f-cc36097fb757 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:32.003945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39cfff-0185-4f83-a192-6149b1709944 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:32.039971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e91d69-7cc3-4fc2-a712-3dc88c3d09d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:32.040842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e91d69-7cc3-4fc2-a712-3dc88c3d09d9 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:32.041123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e91d69-7cc3-4fc2-a712-3dc88c3d09d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:32.041395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e91d69-7cc3-4fc2-a712-3dc88c3d09d9 None admin] PATH_INFO: `/v3/users/693008c321194ab9b799c5831e6413ab` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:32.042743 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e91d69-7cc3-4fc2-a712-3dc88c3d09d9 None admin] RBAC: Authorizing `identity:get_user(user_id=693008c321194ab9b799c5831e6413ab)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:32.044296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e91d69-7cc3-4fc2-a712-3dc88c3d09d9 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:32.046883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 45/91] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:31 2022] GET /identity/v3/users/693008c321194ab9b799c5831e6413ab => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:32.047713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e91d69-7cc3-4fc2-a712-3dc88c3d09d9 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:32.078659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfab8e-2be5-4c1c-a95f-cc36097fb757 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:32.114490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcc4f2-e68d-4b34-b484-9cb9c0f34f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:32.115180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc4f2-e68d-4b34-b484-9cb9c0f34f0d None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:32.115462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc4f2-e68d-4b34-b484-9cb9c0f34f0d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:32.115740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc4f2-e68d-4b34-b484-9cb9c0f34f0d None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:32.116462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcc4f2-e68d-4b34-b484-9cb9c0f34f0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:32.117934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcc4f2-e68d-4b34-b484-9cb9c0f34f0d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:32.154246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 47/92] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:38:31 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:32.155228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcc4f2-e68d-4b34-b484-9cb9c0f34f0d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:32.162909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e91d69-7cc3-4fc2-a712-3dc88c3d09d9 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:32.229788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3105d0-e776-4297-a939-b50802a3c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:32.230800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3105d0-e776-4297-a939-b50802a3c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:32.231079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3105d0-e776-4297-a939-b50802a3c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:32.231363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3105d0-e776-4297-a939-b50802a3c3f8 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:32.236147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3105d0-e776-4297-a939-b50802a3c3f8 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:32.239359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3105d0-e776-4297-a939-b50802a3c3f8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:32.243577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 46/93] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:32 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:32.248478 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3105d0-e776-4297-a939-b50802a3c3f8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:32.352022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcc4f2-e68d-4b34-b484-9cb9c0f34f0d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:32.414690 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3105d0-e776-4297-a939-b50802a3c3f8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:32.430961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1374f8-a389-4b7a-827a-3446e78f3c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:32.432005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1374f8-a389-4b7a-827a-3446e78f3c80 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:32.432292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1374f8-a389-4b7a-827a-3446e78f3c80 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:32.432960 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1374f8-a389-4b7a-827a-3446e78f3c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:32.456719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e4206-e069-4266-b245-0668275ea58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:32.457396 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e4206-e069-4266-b245-0668275ea58b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:32.457667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e4206-e069-4266-b245-0668275ea58b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:32.457939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e4206-e069-4266-b245-0668275ea58b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:32.459263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e4206-e069-4266-b245-0668275ea58b None admin] RBAC: Adding query filter params (role.id=23f476d154c04684802479843819b199, scope.project.id=1aca8b3a36e4474591361aeac183f0b4, user.id=693008c321194ab9b799c5831e6413ab) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:32.459843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e4206-e069-4266-b245-0668275ea58b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:32.461804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e4206-e069-4266-b245-0668275ea58b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:32.469192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 47/94] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:32 2022] GET /identity/v3/role_assignments?user.id=693008c321194ab9b799c5831e6413ab&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=23f476d154c04684802479843819b199 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:32.517424 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1374f8-a389-4b7a-827a-3446e78f3c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:32.518981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1374f8-a389-4b7a-827a-3446e78f3c80 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:32.625707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 48/95] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:32.631451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e4206-e069-4266-b245-0668275ea58b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:32.740134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e4206-e069-4266-b245-0668275ea58b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:32.775035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a154f4a-b31a-4772-8e2d-a4c0e56185a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:32.775896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a154f4a-b31a-4772-8e2d-a4c0e56185a6 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:32.776183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a154f4a-b31a-4772-8e2d-a4c0e56185a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:32.776464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a154f4a-b31a-4772-8e2d-a4c0e56185a6 None admin] PATH_INFO: `/v3/projects/1ca33d16dc6f4018b10dc423d7b5ff07` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:32.777689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a154f4a-b31a-4772-8e2d-a4c0e56185a6 None admin] RBAC: Authorizing `identity:get_project(project_id=1ca33d16dc6f4018b10dc423d7b5ff07)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:32.779225 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a154f4a-b31a-4772-8e2d-a4c0e56185a6 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:32.780998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 48/96] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:32 2022] GET /identity/v3/projects/1ca33d16dc6f4018b10dc423d7b5ff07 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:32.787048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1374f8-a389-4b7a-827a-3446e78f3c80 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:32.893744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1374f8-a389-4b7a-827a-3446e78f3c80 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:32.928555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd16e2c-be14-4dad-8421-902b2204b5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:32.929231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16e2c-be14-4dad-8421-902b2204b5ea None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:32.929515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16e2c-be14-4dad-8421-902b2204b5ea None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:32.929795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16e2c-be14-4dad-8421-902b2204b5ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:32.930682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd16e2c-be14-4dad-8421-902b2204b5ea None admin] RBAC: Adding query filter params (role.id=20d2df2c0f34477d842f0e792557bb47, scope.project.id=1ca33d16dc6f4018b10dc423d7b5ff07, user.id=693008c321194ab9b799c5831e6413ab) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:32.930996 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd16e2c-be14-4dad-8421-902b2204b5ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:32.932489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd16e2c-be14-4dad-8421-902b2204b5ea None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:32.938701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 49/97] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:32 2022] GET /identity/v3/role_assignments?user.id=693008c321194ab9b799c5831e6413ab&scope.project.id=1ca33d16dc6f4018b10dc423d7b5ff07&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:34.640380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e955f-30b8-4fae-93b6-05463f65c037 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:34.640380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e955f-30b8-4fae-93b6-05463f65c037 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:34.640380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e955f-30b8-4fae-93b6-05463f65c037 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:34.641271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 49/98] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:34.649319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c81489-db88-493a-b588-828c57a24db4 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:34.649714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c81489-db88-493a-b588-828c57a24db4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:34.649877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c81489-db88-493a-b588-828c57a24db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:34.675043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b0c81489-db88-493a-b588-828c57a24db4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:34.676346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b0c81489-db88-493a-b588-828c57a24db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:34.752416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 50/99] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:34.791540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e955f-30b8-4fae-93b6-05463f65c037 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:34.891822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350488a6-e2cc-4105-a423-8478ee249027 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:34.892003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350488a6-e2cc-4105-a423-8478ee249027 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:34.892280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350488a6-e2cc-4105-a423-8478ee249027 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:34.894370 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 51/100] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:34.898996 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90275c-17ca-452a-b67f-70a09d03101d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:34.899280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90275c-17ca-452a-b67f-70a09d03101d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:34.899555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90275c-17ca-452a-b67f-70a09d03101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:34.927095 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fc90275c-17ca-452a-b67f-70a09d03101d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:34.928279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fc90275c-17ca-452a-b67f-70a09d03101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:34.938794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e955f-30b8-4fae-93b6-05463f65c037 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:35.010382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a73f69-b52c-4c8f-87a0-59405330ab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:35.011266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73f69-b52c-4c8f-87a0-59405330ab21 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:35.011549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73f69-b52c-4c8f-87a0-59405330ab21 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:35.011825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73f69-b52c-4c8f-87a0-59405330ab21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:35.035142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a73f69-b52c-4c8f-87a0-59405330ab21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:35.043707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 52/101] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:38:35.044158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-51a73f69-b52c-4c8f-87a0-59405330ab21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:38:35.045577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 50/102] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:35.052058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90275c-17ca-452a-b67f-70a09d03101d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:35.076304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a73f69-b52c-4c8f-87a0-59405330ab21 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:35.160446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90275c-17ca-452a-b67f-70a09d03101d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:35.210851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518d954-8b95-47f1-832f-2b7404025c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:35.211829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518d954-8b95-47f1-832f-2b7404025c84 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:35.212248 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518d954-8b95-47f1-832f-2b7404025c84 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:35.212678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518d954-8b95-47f1-832f-2b7404025c84 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:35.213602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518d954-8b95-47f1-832f-2b7404025c84 None admin] RBAC: Adding query filter params (name=member) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:35.214047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518d954-8b95-47f1-832f-2b7404025c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:35.215638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518d954-8b95-47f1-832f-2b7404025c84 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:35.217379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a73f69-b52c-4c8f-87a0-59405330ab21 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:35.224921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 53/103] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:35.230426 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518d954-8b95-47f1-832f-2b7404025c84 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:35.256042 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5bc7-534b-4297-8a6d-a97c67bb59c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:35.257301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5bc7-534b-4297-8a6d-a97c67bb59c0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:35.258888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5bc7-534b-4297-8a6d-a97c67bb59c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:35.259381 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5bc7-534b-4297-8a6d-a97c67bb59c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:35.278027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f5bc7-534b-4297-8a6d-a97c67bb59c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:35.286215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-ca1f5bc7-534b-4297-8a6d-a97c67bb59c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:38:35.287897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 51/104] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:38:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:35.295046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5bc7-534b-4297-8a6d-a97c67bb59c0 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:35.361474 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518d954-8b95-47f1-832f-2b7404025c84 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:35.422902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0db4e-4897-4bc7-92bb-e4f3f931a8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:35.424323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0db4e-4897-4bc7-92bb-e4f3f931a8b6 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:35.424845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0db4e-4897-4bc7-92bb-e4f3f931a8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:35.425316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0db4e-4897-4bc7-92bb-e4f3f931a8b6 None admin] PATH_INFO: `/v3/users/693008c321194ab9b799c5831e6413ab` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:35.431057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0db4e-4897-4bc7-92bb-e4f3f931a8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=693008c321194ab9b799c5831e6413ab)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:35.432939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0db4e-4897-4bc7-92bb-e4f3f931a8b6 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:35.435067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 54/105] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:35 2022] GET /identity/v3/users/693008c321194ab9b799c5831e6413ab => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:35.451225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0db4e-4897-4bc7-92bb-e4f3f931a8b6 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:35.454958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5bc7-534b-4297-8a6d-a97c67bb59c0 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:35.497760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550914fc-0f2f-47b1-a70f-1006af942cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:35.498528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550914fc-0f2f-47b1-a70f-1006af942cbb None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:35.498872 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550914fc-0f2f-47b1-a70f-1006af942cbb None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:35.499154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550914fc-0f2f-47b1-a70f-1006af942cbb None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:35.499999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550914fc-0f2f-47b1-a70f-1006af942cbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:35.500309 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550914fc-0f2f-47b1-a70f-1006af942cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:35.501783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550914fc-0f2f-47b1-a70f-1006af942cbb None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:35.515222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 52/106] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:35.520866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550914fc-0f2f-47b1-a70f-1006af942cbb None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:35.637662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550914fc-0f2f-47b1-a70f-1006af942cbb None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:35.685302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509726-a73e-4f65-b61c-428d49edb391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:35.686209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509726-a73e-4f65-b61c-428d49edb391 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:35.686499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509726-a73e-4f65-b61c-428d49edb391 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:35.686834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509726-a73e-4f65-b61c-428d49edb391 None admin] PATH_INFO: `/v3/users/90024dc2520a490e92255f559b6d8bd9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:35.687733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0db4e-4897-4bc7-92bb-e4f3f931a8b6 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:35.690828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c509726-a73e-4f65-b61c-428d49edb391 None admin] RBAC: Authorizing `identity:get_user(user_id=90024dc2520a490e92255f559b6d8bd9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:35.692606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c509726-a73e-4f65-b61c-428d49edb391 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:35.694494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 53/107] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:35 2022] GET /identity/v3/users/90024dc2520a490e92255f559b6d8bd9 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:35.700171 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509726-a73e-4f65-b61c-428d49edb391 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:35.730288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b46ed-be26-46fc-b165-320b7dc16563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:35.731562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b46ed-be26-46fc-b165-320b7dc16563 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:35.732033 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b46ed-be26-46fc-b165-320b7dc16563 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:35.732517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b46ed-be26-46fc-b165-320b7dc16563 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:35.738930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b46ed-be26-46fc-b165-320b7dc16563 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:35.740618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b46ed-be26-46fc-b165-320b7dc16563 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:35.742599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 55/108] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:35 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:35.753143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b46ed-be26-46fc-b165-320b7dc16563 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:35.856316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509726-a73e-4f65-b61c-428d49edb391 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:35.918907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b46ed-be26-46fc-b165-320b7dc16563 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:35.946830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61c433-70c8-4c9a-bc95-a76fadba2556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:35.947691 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c433-70c8-4c9a-bc95-a76fadba2556 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:35.947990 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c433-70c8-4c9a-bc95-a76fadba2556 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:35.948254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c433-70c8-4c9a-bc95-a76fadba2556 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:35.952801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61c433-70c8-4c9a-bc95-a76fadba2556 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:35.954970 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61c433-70c8-4c9a-bc95-a76fadba2556 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:35.957488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 54/109] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:35 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:35.960207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e31e-4781-4dcf-9def-3f4324757774 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:35.961044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d29ba-dddf-4e96-a429-1891023859a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:35.962184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d29ba-dddf-4e96-a429-1891023859a0 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:35.962653 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d29ba-dddf-4e96-a429-1891023859a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:35.963454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d29ba-dddf-4e96-a429-1891023859a0 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4/users/693008c321194ab9b799c5831e6413ab/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:35.964750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e31e-4781-4dcf-9def-3f4324757774 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:35.965701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e31e-4781-4dcf-9def-3f4324757774 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:35.966620 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d29ba-dddf-4e96-a429-1891023859a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1aca8b3a36e4474591361aeac183f0b4, user_id=693008c321194ab9b799c5831e6413ab, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:35.968606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 55/110] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:35.970397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d29ba-dddf-4e96-a429-1891023859a0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:35.971333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040e31e-4781-4dcf-9def-3f4324757774 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:36.002179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 56/111] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:38:35 2022] PUT /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4/users/693008c321194ab9b799c5831e6413ab/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:38:36.003833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d72ee-ebf1-4662-a4ba-3521d81b881f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.004314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d72ee-ebf1-4662-a4ba-3521d81b881f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.004780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d72ee-ebf1-4662-a4ba-3521d81b881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.039288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-533d72ee-ebf1-4662-a4ba-3521d81b881f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:36.040939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-533d72ee-ebf1-4662-a4ba-3521d81b881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:36.116104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040e31e-4781-4dcf-9def-3f4324757774 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:36.149442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 57/112] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:36.151301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cbb6b-1ec4-4e9b-a3a7-e6bcb2624b29 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.152803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cbb6b-1ec4-4e9b-a3a7-e6bcb2624b29 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.154444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cbb6b-1ec4-4e9b-a3a7-e6bcb2624b29 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.156649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 58/113] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:36.167738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9dc4-68d0-4ebb-a544-566417449b01 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.168358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9dc4-68d0-4ebb-a544-566417449b01 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.168823 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9dc4-68d0-4ebb-a544-566417449b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.188600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3820849-e105-434d-8071-3b3037846392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:36.189584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3820849-e105-434d-8071-3b3037846392 None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.189871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3820849-e105-434d-8071-3b3037846392 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.190179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3820849-e105-434d-8071-3b3037846392 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4/users/90024dc2520a490e92255f559b6d8bd9/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.193847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-46ea9dc4-68d0-4ebb-a544-566417449b01 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:36.194836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3820849-e105-434d-8071-3b3037846392 None admin] RBAC: Authorizing `identity:create_grant(project_id=1aca8b3a36e4474591361aeac183f0b4, user_id=90024dc2520a490e92255f559b6d8bd9, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:36.196229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-46ea9dc4-68d0-4ebb-a544-566417449b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:36.199719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3820849-e105-434d-8071-3b3037846392 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:36.233464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 56/114] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:38:35 2022] PUT /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4/users/90024dc2520a490e92255f559b6d8bd9/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:38:36.234992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3820849-e105-434d-8071-3b3037846392 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:36.303724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 59/115] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:36.338760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9dc4-68d0-4ebb-a544-566417449b01 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:36.481827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3820849-e105-434d-8071-3b3037846392 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:36.489189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9dc4-68d0-4ebb-a544-566417449b01 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:36.519496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e1faf-21df-496f-9337-b5cbdbd62424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:36.520853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e1faf-21df-496f-9337-b5cbdbd62424 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.521332 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e1faf-21df-496f-9337-b5cbdbd62424 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.521886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e1faf-21df-496f-9337-b5cbdbd62424 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.523335 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ed8eb-a226-41c2-bab8-141958250e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:36.524153 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed8eb-a226-41c2-bab8-141958250e6f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.524490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed8eb-a226-41c2-bab8-141958250e6f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.524704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed8eb-a226-41c2-bab8-141958250e6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.535312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ed8eb-a226-41c2-bab8-141958250e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:36.536097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e1faf-21df-496f-9337-b5cbdbd62424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:36.542509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-8b7ed8eb-a226-41c2-bab8-141958250e6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:38:36.543747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 60/116] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:38:36.544484 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-079e1faf-21df-496f-9337-b5cbdbd62424 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:38:36.545157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05167738-7b17-40e9-9437-0c23cc6e362f None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.545441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05167738-7b17-40e9-9437-0c23cc6e362f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.545726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05167738-7b17-40e9-9437-0c23cc6e362f None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.547034 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 57/117] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:38:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:36.548078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 61/118] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:36.550033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e1faf-21df-496f-9337-b5cbdbd62424 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:36.556075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce6b67-f731-4e69-b633-a731d6a37b20 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.557598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce6b67-f731-4e69-b633-a731d6a37b20 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.558103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce6b67-f731-4e69-b633-a731d6a37b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.576133 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-bcce6b67-f731-4e69-b633-a731d6a37b20 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:36.577895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-bcce6b67-f731-4e69-b633-a731d6a37b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:36.650143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 62/119] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:36.651333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce6b67-f731-4e69-b633-a731d6a37b20 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:36.654924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e1faf-21df-496f-9337-b5cbdbd62424 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:36.687458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a57ca-df2e-46e7-beff-9d8f0cc7655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:36.688083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a57ca-df2e-46e7-beff-9d8f0cc7655a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.688369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a57ca-df2e-46e7-beff-9d8f0cc7655a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.688650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a57ca-df2e-46e7-beff-9d8f0cc7655a None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.689408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a57ca-df2e-46e7-beff-9d8f0cc7655a None admin] RBAC: Adding query filter params (name=member) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:36.689776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a57ca-df2e-46e7-beff-9d8f0cc7655a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:36.691153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a57ca-df2e-46e7-beff-9d8f0cc7655a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:36.699723 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 58/120] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:36.701070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1494-0888-4e80-924f-b0c75b8d72af None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.701070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1494-0888-4e80-924f-b0c75b8d72af None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.701382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1494-0888-4e80-924f-b0c75b8d72af None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.708324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 59/121] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:36.709096 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a1494-0888-4e80-924f-b0c75b8d72af None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:36.759641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce6b67-f731-4e69-b633-a731d6a37b20 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:36.793704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ef058-48fb-4a5f-8790-db84212a22a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:36.794890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ef058-48fb-4a5f-8790-db84212a22a8 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.795366 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ef058-48fb-4a5f-8790-db84212a22a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.796217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ef058-48fb-4a5f-8790-db84212a22a8 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.797234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ef058-48fb-4a5f-8790-db84212a22a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:36.797727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ef058-48fb-4a5f-8790-db84212a22a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:36.799395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ef058-48fb-4a5f-8790-db84212a22a8 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:36.807788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 63/122] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:38:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:36.808990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ef058-48fb-4a5f-8790-db84212a22a8 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:36.813896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a1494-0888-4e80-924f-b0c75b8d72af None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:36.846962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ebef3-623c-41ff-a24a-d2adf00ace08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:36.847775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ebef3-623c-41ff-a24a-d2adf00ace08 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.848060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ebef3-623c-41ff-a24a-d2adf00ace08 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.848338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ebef3-623c-41ff-a24a-d2adf00ace08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.858544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ebef3-623c-41ff-a24a-d2adf00ace08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:36.865735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-268ebef3-623c-41ff-a24a-d2adf00ace08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:38:36.871722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 60/123] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:36.873061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf382317-68d6-4104-ba15-97432f5ea95a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.873356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf382317-68d6-4104-ba15-97432f5ea95a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.873635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf382317-68d6-4104-ba15-97432f5ea95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.893491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-bf382317-68d6-4104-ba15-97432f5ea95a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:36.894716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bf382317-68d6-4104-ba15-97432f5ea95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:36.911058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ef058-48fb-4a5f-8790-db84212a22a8 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:36.945131 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cef0d-4edb-4e65-a81c-b7833145fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:36.946439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cef0d-4edb-4e65-a81c-b7833145fc12 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:36.946911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cef0d-4edb-4e65-a81c-b7833145fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:36.947369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cef0d-4edb-4e65-a81c-b7833145fc12 None admin] PATH_INFO: `/v3/users/693008c321194ab9b799c5831e6413ab` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:36.948787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cef0d-4edb-4e65-a81c-b7833145fc12 None admin] RBAC: Authorizing `identity:get_user(user_id=693008c321194ab9b799c5831e6413ab)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:36.950517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cef0d-4edb-4e65-a81c-b7833145fc12 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:36.952474 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 64/124] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:36 2022] GET /identity/v3/users/693008c321194ab9b799c5831e6413ab => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:36.953539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cef0d-4edb-4e65-a81c-b7833145fc12 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:36.965675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 61/125] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:36.966575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf382317-68d6-4104-ba15-97432f5ea95a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:37.057273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cef0d-4edb-4e65-a81c-b7833145fc12 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:37.091180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66786fe3-362d-4fa9-a41f-c438c9755ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:37.091777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf382317-68d6-4104-ba15-97432f5ea95a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:37.092666 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66786fe3-362d-4fa9-a41f-c438c9755ea8 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:37.093178 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66786fe3-362d-4fa9-a41f-c438c9755ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:37.093663 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66786fe3-362d-4fa9-a41f-c438c9755ea8 None admin] PATH_INFO: `/v3/users/693008c321194ab9b799c5831e6413ab` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:37.095105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66786fe3-362d-4fa9-a41f-c438c9755ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=693008c321194ab9b799c5831e6413ab)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:37.096847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66786fe3-362d-4fa9-a41f-c438c9755ea8 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:37.098927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 65/126] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:36 2022] GET /identity/v3/users/693008c321194ab9b799c5831e6413ab => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:37.099964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66786fe3-362d-4fa9-a41f-c438c9755ea8 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:37.128996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827c645-4377-4ae7-ad43-e3c4f2111349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:37.129903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827c645-4377-4ae7-ad43-e3c4f2111349 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:37.130225 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827c645-4377-4ae7-ad43-e3c4f2111349 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:37.130506 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827c645-4377-4ae7-ad43-e3c4f2111349 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:37.131264 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827c645-4377-4ae7-ad43-e3c4f2111349 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:37.131573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827c645-4377-4ae7-ad43-e3c4f2111349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:37.133040 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827c645-4377-4ae7-ad43-e3c4f2111349 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:37.142039 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 62/127] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:37.142938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827c645-4377-4ae7-ad43-e3c4f2111349 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:37.202873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66786fe3-362d-4fa9-a41f-c438c9755ea8 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:37.236227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849e78-3679-4db3-851d-a8bc323e95e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:37.237520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849e78-3679-4db3-851d-a8bc323e95e3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:37.237992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849e78-3679-4db3-851d-a8bc323e95e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:37.238498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849e78-3679-4db3-851d-a8bc323e95e3 None admin] PATH_INFO: `/v3/projects/1ca33d16dc6f4018b10dc423d7b5ff07` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:37.239932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849e78-3679-4db3-851d-a8bc323e95e3 None admin] RBAC: Authorizing `identity:get_project(project_id=1ca33d16dc6f4018b10dc423d7b5ff07)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:37.241670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849e78-3679-4db3-851d-a8bc323e95e3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:37.243620 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 66/128] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:37 2022] GET /identity/v3/projects/1ca33d16dc6f4018b10dc423d7b5ff07 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:37.243924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827c645-4377-4ae7-ad43-e3c4f2111349 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:37.244990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849e78-3679-4db3-851d-a8bc323e95e3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:37.278707 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316126-f083-4dc6-a189-f391754307c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:37.279526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316126-f083-4dc6-a189-f391754307c4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:37.279811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316126-f083-4dc6-a189-f391754307c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:37.280089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316126-f083-4dc6-a189-f391754307c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:37.282322 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316126-f083-4dc6-a189-f391754307c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:37.283810 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316126-f083-4dc6-a189-f391754307c4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:37.285711 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 63/129] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:37.286977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316126-f083-4dc6-a189-f391754307c4 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:37.345499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849e78-3679-4db3-851d-a8bc323e95e3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:37.378494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361718df-5434-4756-b65b-fcef5fe508d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:37.379456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361718df-5434-4756-b65b-fcef5fe508d3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:37.379736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361718df-5434-4756-b65b-fcef5fe508d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:37.380057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361718df-5434-4756-b65b-fcef5fe508d3 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:37.381414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361718df-5434-4756-b65b-fcef5fe508d3 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:37.383052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361718df-5434-4756-b65b-fcef5fe508d3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:37.384899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 67/130] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:37 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:37.385698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361718df-5434-4756-b65b-fcef5fe508d3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:37.416230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316126-f083-4dc6-a189-f391754307c4 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:37.458876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60040c-ce38-4dbc-9f01-1f0909c91883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:37.459767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60040c-ce38-4dbc-9f01-1f0909c91883 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:37.460049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60040c-ce38-4dbc-9f01-1f0909c91883 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:37.460322 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60040c-ce38-4dbc-9f01-1f0909c91883 None admin] PATH_INFO: `/v3/users/bcd9b0920f964f99bf20aef46afa8dad` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:37.474425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60040c-ce38-4dbc-9f01-1f0909c91883 None admin] RBAC: Authorizing `identity:get_user(user_id=bcd9b0920f964f99bf20aef46afa8dad)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:37.475931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60040c-ce38-4dbc-9f01-1f0909c91883 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:37.477673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 64/131] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:37 2022] GET /identity/v3/users/bcd9b0920f964f99bf20aef46afa8dad => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:37.478698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60040c-ce38-4dbc-9f01-1f0909c91883 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:37.492650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361718df-5434-4756-b65b-fcef5fe508d3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:37.525677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2185b-65a5-428e-a951-b8caee752998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:37.526664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2185b-65a5-428e-a951-b8caee752998 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:37.526942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2185b-65a5-428e-a951-b8caee752998 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:37.527214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2185b-65a5-428e-a951-b8caee752998 None admin] PATH_INFO: `/v3/projects/1ca33d16dc6f4018b10dc423d7b5ff07/users/693008c321194ab9b799c5831e6413ab/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:37.529150 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2185b-65a5-428e-a951-b8caee752998 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ca33d16dc6f4018b10dc423d7b5ff07, user_id=693008c321194ab9b799c5831e6413ab, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:37.530757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2185b-65a5-428e-a951-b8caee752998 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:37.544754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 68/132] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:38:37 2022] PUT /identity/v3/projects/1ca33d16dc6f4018b10dc423d7b5ff07/users/693008c321194ab9b799c5831e6413ab/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:38:37.545712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2185b-65a5-428e-a951-b8caee752998 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:37.582261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60040c-ce38-4dbc-9f01-1f0909c91883 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:37.618837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ece506-f2e2-4ec9-b5a9-020c91f9c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:37.619446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece506-f2e2-4ec9-b5a9-020c91f9c5a8 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:37.619741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece506-f2e2-4ec9-b5a9-020c91f9c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:37.620022 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece506-f2e2-4ec9-b5a9-020c91f9c5a8 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:37.620769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ece506-f2e2-4ec9-b5a9-020c91f9c5a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:37.622314 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ece506-f2e2-4ec9-b5a9-020c91f9c5a8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:37.678821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2185b-65a5-428e-a951-b8caee752998 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:37.718253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 65/133] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:38:37 2022] POST /identity/v3/projects => generated 302 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:37.718894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fd956-495e-4cac-b4d9-8f4bdec4f65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:37.719957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fd956-495e-4cac-b4d9-8f4bdec4f65e None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:37.720246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fd956-495e-4cac-b4d9-8f4bdec4f65e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:37.720527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ece506-f2e2-4ec9-b5a9-020c91f9c5a8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:37.720622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fd956-495e-4cac-b4d9-8f4bdec4f65e None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4/users/693008c321194ab9b799c5831e6413ab/roles/23f476d154c04684802479843819b199` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:37.726111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fd956-495e-4cac-b4d9-8f4bdec4f65e None admin] RBAC: Authorizing `identity:create_grant(project_id=1aca8b3a36e4474591361aeac183f0b4, user_id=693008c321194ab9b799c5831e6413ab, role_id=23f476d154c04684802479843819b199)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:37.728193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fd956-495e-4cac-b4d9-8f4bdec4f65e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:37.755893 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 69/134] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:38:37 2022] PUT /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4/users/693008c321194ab9b799c5831e6413ab/roles/23f476d154c04684802479843819b199 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:38:37.887959 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ece506-f2e2-4ec9-b5a9-020c91f9c5a8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:37.930804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074214e-46fd-4e0a-9186-c88f9ce5cab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:37.931588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074214e-46fd-4e0a-9186-c88f9ce5cab8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:37.931932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074214e-46fd-4e0a-9186-c88f9ce5cab8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:37.932208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074214e-46fd-4e0a-9186-c88f9ce5cab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:38.022008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074214e-46fd-4e0a-9186-c88f9ce5cab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:38.023568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074214e-46fd-4e0a-9186-c88f9ce5cab8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:38.128420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 66/135] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:38.134180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fd956-495e-4cac-b4d9-8f4bdec4f65e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:38.261086 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fd956-495e-4cac-b4d9-8f4bdec4f65e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:38.295705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391eb529-cf32-47b0-b61a-329ece2ea8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:38.296985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eb529-cf32-47b0-b61a-329ece2ea8ca None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:38.297263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eb529-cf32-47b0-b61a-329ece2ea8ca None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:38.297531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eb529-cf32-47b0-b61a-329ece2ea8ca None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:38.298746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391eb529-cf32-47b0-b61a-329ece2ea8ca None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:38.300218 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391eb529-cf32-47b0-b61a-329ece2ea8ca None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:38.302166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 70/136] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:38 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:38.307963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074214e-46fd-4e0a-9186-c88f9ce5cab8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:38.448484 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074214e-46fd-4e0a-9186-c88f9ce5cab8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:38.494630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cf67b-6578-4e79-a4eb-06a511ade9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:38.495668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf67b-6578-4e79-a4eb-06a511ade9c1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:38.496172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf67b-6578-4e79-a4eb-06a511ade9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:38.496648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf67b-6578-4e79-a4eb-06a511ade9c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:38.497677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cf67b-6578-4e79-a4eb-06a511ade9c1 None admin] RBAC: Adding query filter params (role.id=43312a4c8be340a889e15774cd34870a, scope.project.id=1aca8b3a36e4474591361aeac183f0b4, user.id=bcd9b0920f964f99bf20aef46afa8dad) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:38.498231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cf67b-6578-4e79-a4eb-06a511ade9c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:38.499979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cf67b-6578-4e79-a4eb-06a511ade9c1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:38.510859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 67/137] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:38 2022] GET /identity/v3/role_assignments?user.id=bcd9b0920f964f99bf20aef46afa8dad&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=43312a4c8be340a889e15774cd34870a => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:39.133676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea784-f5fd-406f-8cdb-65b7daa82062 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:39.134058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea784-f5fd-406f-8cdb-65b7daa82062 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:39.134270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea784-f5fd-406f-8cdb-65b7daa82062 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:39.136290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 71/138] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:39.141836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84f127-6044-4ead-9281-8d1a56b10133 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:39.142280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84f127-6044-4ead-9281-8d1a56b10133 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:39.142467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84f127-6044-4ead-9281-8d1a56b10133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:39.162036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1a84f127-6044-4ead-9281-8d1a56b10133 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:39.163243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1a84f127-6044-4ead-9281-8d1a56b10133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:39.246069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 68/139] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:39.252703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1136-8456-473e-88c7-53d6a90ed401 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:39.252994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1136-8456-473e-88c7-53d6a90ed401 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:39.253281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1136-8456-473e-88c7-53d6a90ed401 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:39.255299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 72/140] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:39.260221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18e49e-7df5-498e-8c43-a48e6175da74 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:39.260519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18e49e-7df5-498e-8c43-a48e6175da74 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:39.260799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18e49e-7df5-498e-8c43-a48e6175da74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:39.283773 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-3f18e49e-7df5-498e-8c43-a48e6175da74 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:39.284071 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a1136-8456-473e-88c7-53d6a90ed401 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:39.285048 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3f18e49e-7df5-498e-8c43-a48e6175da74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:39.396441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 69/141] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:39.434569 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18e49e-7df5-498e-8c43-a48e6175da74 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:39.441172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a1136-8456-473e-88c7-53d6a90ed401 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:39.515534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad82bcf-64df-4254-91b4-d712a1d8f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:39.516486 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad82bcf-64df-4254-91b4-d712a1d8f4ac None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:39.516637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad82bcf-64df-4254-91b4-d712a1d8f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:39.516905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad82bcf-64df-4254-91b4-d712a1d8f4ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:39.547278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad82bcf-64df-4254-91b4-d712a1d8f4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:39.554377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-aad82bcf-64df-4254-91b4-d712a1d8f4ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:38:39.561131 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 73/142] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:39.565346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18e49e-7df5-498e-8c43-a48e6175da74 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:39.567119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad82bcf-64df-4254-91b4-d712a1d8f4ac None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:39.602299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e420c-12d9-413d-8b0f-519a185f721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:39.603129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e420c-12d9-413d-8b0f-519a185f721b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:39.603414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e420c-12d9-413d-8b0f-519a185f721b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:39.603688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e420c-12d9-413d-8b0f-519a185f721b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:39.621939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e420c-12d9-413d-8b0f-519a185f721b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:39.643289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-311e420c-12d9-413d-8b0f-519a185f721b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:38:39.651126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 70/143] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:39.660129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e420c-12d9-413d-8b0f-519a185f721b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:39.771170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad82bcf-64df-4254-91b4-d712a1d8f4ac None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:39.824384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8253-c3e6-472c-a38b-134230464f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:39.825447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8253-c3e6-472c-a38b-134230464f21 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:39.825902 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e420c-12d9-413d-8b0f-519a185f721b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:39.826140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8253-c3e6-472c-a38b-134230464f21 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:39.826628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8253-c3e6-472c-a38b-134230464f21 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:39.827635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8253-c3e6-472c-a38b-134230464f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:39.828136 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8253-c3e6-472c-a38b-134230464f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:39.829758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8253-c3e6-472c-a38b-134230464f21 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:39.846223 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 74/144] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:39.852196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8253-c3e6-472c-a38b-134230464f21 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:39.863318 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3d9a6-f432-4979-98c6-32305552cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:39.865956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d9a6-f432-4979-98c6-32305552cd3e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:39.866271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d9a6-f432-4979-98c6-32305552cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:39.866549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d9a6-f432-4979-98c6-32305552cd3e None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:39.867319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d9a6-f432-4979-98c6-32305552cd3e None admin] RBAC: Adding query filter params (name=member) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:39.867629 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d9a6-f432-4979-98c6-32305552cd3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:39.871171 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d9a6-f432-4979-98c6-32305552cd3e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:39.887833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 71/145] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:39.895685 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3d9a6-f432-4979-98c6-32305552cd3e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:40.050715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8253-c3e6-472c-a38b-134230464f21 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:40.084207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3d9a6-f432-4979-98c6-32305552cd3e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:40.114121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4390aa-7fb3-4fa7-85b9-9f064d472177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:40.115046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4390aa-7fb3-4fa7-85b9-9f064d472177 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:40.115330 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4390aa-7fb3-4fa7-85b9-9f064d472177 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:40.115605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4390aa-7fb3-4fa7-85b9-9f064d472177 None admin] PATH_INFO: `/v3/users/90024dc2520a490e92255f559b6d8bd9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:40.123070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4390aa-7fb3-4fa7-85b9-9f064d472177 None admin] RBAC: Authorizing `identity:get_user(user_id=90024dc2520a490e92255f559b6d8bd9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:40.124603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4390aa-7fb3-4fa7-85b9-9f064d472177 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:40.126768 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 75/146] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:39 2022] GET /identity/v3/users/90024dc2520a490e92255f559b6d8bd9 => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:40.134890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4390aa-7fb3-4fa7-85b9-9f064d472177 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:40.166838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc28ef-29a3-4da1-a70f-2388b9351c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:40.167752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc28ef-29a3-4da1-a70f-2388b9351c54 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:40.168042 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc28ef-29a3-4da1-a70f-2388b9351c54 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:40.168319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc28ef-29a3-4da1-a70f-2388b9351c54 None admin] PATH_INFO: `/v3/users/693008c321194ab9b799c5831e6413ab` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:40.169598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc28ef-29a3-4da1-a70f-2388b9351c54 None admin] RBAC: Authorizing `identity:get_user(user_id=693008c321194ab9b799c5831e6413ab)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:40.171625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc28ef-29a3-4da1-a70f-2388b9351c54 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:40.173194 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 72/147] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:39 2022] GET /identity/v3/users/693008c321194ab9b799c5831e6413ab => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:40.183722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc28ef-29a3-4da1-a70f-2388b9351c54 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:40.255067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4390aa-7fb3-4fa7-85b9-9f064d472177 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:40.298817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69f875-c868-4355-a46d-9c3be3db767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:40.299504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69f875-c868-4355-a46d-9c3be3db767f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:40.299787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69f875-c868-4355-a46d-9c3be3db767f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:40.300062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69f875-c868-4355-a46d-9c3be3db767f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:40.362709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc28ef-29a3-4da1-a70f-2388b9351c54 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:40.402707 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06e821-8e3b-4f83-9801-5e2020a66877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:40.403377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06e821-8e3b-4f83-9801-5e2020a66877 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:40.403659 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06e821-8e3b-4f83-9801-5e2020a66877 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:40.403935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06e821-8e3b-4f83-9801-5e2020a66877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:40.467333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69f875-c868-4355-a46d-9c3be3db767f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:40.468943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69f875-c868-4355-a46d-9c3be3db767f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:40.493729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06e821-8e3b-4f83-9801-5e2020a66877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:40.495617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06e821-8e3b-4f83-9801-5e2020a66877 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:40.602354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 73/148] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:40.608578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06e821-8e3b-4f83-9801-5e2020a66877 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:40.696868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 76/149] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:40.702728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69f875-c868-4355-a46d-9c3be3db767f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:40.727561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06e821-8e3b-4f83-9801-5e2020a66877 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:40.774581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c50994-8fba-4e36-842b-d07260ac7e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:40.775489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c50994-8fba-4e36-842b-d07260ac7e09 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:40.775769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c50994-8fba-4e36-842b-d07260ac7e09 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:40.776049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c50994-8fba-4e36-842b-d07260ac7e09 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:40.780973 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c50994-8fba-4e36-842b-d07260ac7e09 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:40.782479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c50994-8fba-4e36-842b-d07260ac7e09 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:40.784216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 74/150] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:40 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:40.785422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c9cdb-2715-4934-ab37-cd97fd0e20e8 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:40.785708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c9cdb-2715-4934-ab37-cd97fd0e20e8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:40.785984 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c9cdb-2715-4934-ab37-cd97fd0e20e8 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:40.787695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 75/151] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:40.801841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c9cdb-2715-4934-ab37-cd97fd0e20e8 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:40.853115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69f875-c868-4355-a46d-9c3be3db767f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:40.894864 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f20dd-f9df-4479-979c-0c04fe50dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:40.895670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f20dd-f9df-4479-979c-0c04fe50dfc2 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:40.895957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f20dd-f9df-4479-979c-0c04fe50dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:40.896233 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f20dd-f9df-4479-979c-0c04fe50dfc2 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:40.898165 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f20dd-f9df-4479-979c-0c04fe50dfc2 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:40.899639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f20dd-f9df-4479-979c-0c04fe50dfc2 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:40.906545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 77/152] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:40 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:40.907862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319a7fb-c70d-421a-9bed-2af3d9b12468 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:40.908152 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319a7fb-c70d-421a-9bed-2af3d9b12468 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:40.908431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319a7fb-c70d-421a-9bed-2af3d9b12468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:40.940176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2319a7fb-c70d-421a-9bed-2af3d9b12468 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:40.942236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2319a7fb-c70d-421a-9bed-2af3d9b12468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:41.025042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 78/153] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:41.025993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319a7fb-c70d-421a-9bed-2af3d9b12468 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:41.031846 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c9cdb-2715-4934-ab37-cd97fd0e20e8 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:41.129333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0146a77-98a6-4326-a072-5226b0423621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:41.130413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0146a77-98a6-4326-a072-5226b0423621 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.130893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0146a77-98a6-4326-a072-5226b0423621 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.131353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0146a77-98a6-4326-a072-5226b0423621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.132399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0146a77-98a6-4326-a072-5226b0423621 None admin] RBAC: Adding query filter params (role.id=20d2df2c0f34477d842f0e792557bb47, scope.project.id=1aca8b3a36e4474591361aeac183f0b4, user.id=693008c321194ab9b799c5831e6413ab) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:41.132914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0146a77-98a6-4326-a072-5226b0423621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:41.134584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0146a77-98a6-4326-a072-5226b0423621 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:41.152392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 76/154] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:40 2022] GET /identity/v3/role_assignments?user.id=693008c321194ab9b799c5831e6413ab&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:41.153755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0146a77-98a6-4326-a072-5226b0423621 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:41.156639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319a7fb-c70d-421a-9bed-2af3d9b12468 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:41.199701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008eeac-fd76-4ef5-ab0f-8e653c6e307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:41.200645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008eeac-fd76-4ef5-ab0f-8e653c6e307d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.201075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008eeac-fd76-4ef5-ab0f-8e653c6e307d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.201523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008eeac-fd76-4ef5-ab0f-8e653c6e307d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.203199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008eeac-fd76-4ef5-ab0f-8e653c6e307d None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=1aca8b3a36e4474591361aeac183f0b4, user.id=90024dc2520a490e92255f559b6d8bd9) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:41.203688 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008eeac-fd76-4ef5-ab0f-8e653c6e307d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:41.205637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008eeac-fd76-4ef5-ab0f-8e653c6e307d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:41.213587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 79/155] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:41 2022] GET /identity/v3/role_assignments?user.id=90024dc2520a490e92255f559b6d8bd9&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:41.337326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0146a77-98a6-4326-a072-5226b0423621 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:41.381065 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914800-057e-432b-a931-8fbb0364e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:41.381913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914800-057e-432b-a931-8fbb0364e53a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.382226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914800-057e-432b-a931-8fbb0364e53a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.382504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914800-057e-432b-a931-8fbb0364e53a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.403469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50914800-057e-432b-a931-8fbb0364e53a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:41.410860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-50914800-057e-432b-a931-8fbb0364e53a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:38:41.412643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 77/156] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:41.419361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008eeac-fd76-4ef5-ab0f-8e653c6e307d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:41.487990 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a166c0-3327-4a5e-9ef9-a73d19a8cec4 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.488270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a166c0-3327-4a5e-9ef9-a73d19a8cec4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.488546 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a166c0-3327-4a5e-9ef9-a73d19a8cec4 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.490647 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 78/157] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:41.495987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f343e0-5c58-4235-a8f2-c192ec4c1379 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.496180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f343e0-5c58-4235-a8f2-c192ec4c1379 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.496431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f343e0-5c58-4235-a8f2-c192ec4c1379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.527993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e0f343e0-5c58-4235-a8f2-c192ec4c1379 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:41.529625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e0f343e0-5c58-4235-a8f2-c192ec4c1379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:41.545698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008eeac-fd76-4ef5-ab0f-8e653c6e307d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:41.587709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6160a-a194-4d4f-868c-cdecd01b97f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:41.588401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6160a-a194-4d4f-868c-cdecd01b97f0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.588683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6160a-a194-4d4f-868c-cdecd01b97f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.588953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6160a-a194-4d4f-868c-cdecd01b97f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.589720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6160a-a194-4d4f-868c-cdecd01b97f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:41.590019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6160a-a194-4d4f-868c-cdecd01b97f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:41.591440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6160a-a194-4d4f-868c-cdecd01b97f0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:41.606885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 80/158] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:41.608232 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13746c1-0dbf-496e-9ef6-60be628b04e5 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.608522 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13746c1-0dbf-496e-9ef6-60be628b04e5 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.608795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13746c1-0dbf-496e-9ef6-60be628b04e5 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.610579 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 81/159] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:41.617092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13746c1-0dbf-496e-9ef6-60be628b04e5 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:41.620439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 79/160] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:41.622182 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51adfd2-ce50-41a1-9ce7-f083baec4d02 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.622645 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51adfd2-ce50-41a1-9ce7-f083baec4d02 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.624292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51adfd2-ce50-41a1-9ce7-f083baec4d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.645891 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c51adfd2-ce50-41a1-9ce7-f083baec4d02 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:41.648283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c51adfd2-ce50-41a1-9ce7-f083baec4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:41.734397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 80/161] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:41.735077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51adfd2-ce50-41a1-9ce7-f083baec4d02 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:41.759350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13746c1-0dbf-496e-9ef6-60be628b04e5 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:41.791439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a293c-d801-4e99-84e8-412ab42b026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:41.792324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a293c-d801-4e99-84e8-412ab42b026f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.792604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a293c-d801-4e99-84e8-412ab42b026f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.792881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a293c-d801-4e99-84e8-412ab42b026f None admin] PATH_INFO: `/v3/users/693008c321194ab9b799c5831e6413ab` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.794064 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a293c-d801-4e99-84e8-412ab42b026f None admin] RBAC: Authorizing `identity:get_user(user_id=693008c321194ab9b799c5831e6413ab)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:41.795556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a293c-d801-4e99-84e8-412ab42b026f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:41.797779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 82/162] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:41 2022] GET /identity/v3/users/693008c321194ab9b799c5831e6413ab => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:41.798404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a293c-d801-4e99-84e8-412ab42b026f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:41.838327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51adfd2-ce50-41a1-9ce7-f083baec4d02 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:41.873502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176970da-ae3d-4b6e-8482-376e5c5b9583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:41.874882 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176970da-ae3d-4b6e-8482-376e5c5b9583 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.875378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176970da-ae3d-4b6e-8482-376e5c5b9583 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.876293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176970da-ae3d-4b6e-8482-376e5c5b9583 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.878116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176970da-ae3d-4b6e-8482-376e5c5b9583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:41.880250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176970da-ae3d-4b6e-8482-376e5c5b9583 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:41.887211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 81/163] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:41.887211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176970da-ae3d-4b6e-8482-376e5c5b9583 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:41.899669 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a293c-d801-4e99-84e8-412ab42b026f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:41.934377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27790fd0-5ee6-4367-966f-586587152eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:41.935311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27790fd0-5ee6-4367-966f-586587152eb7 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:41.935504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27790fd0-5ee6-4367-966f-586587152eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:41.935776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27790fd0-5ee6-4367-966f-586587152eb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:41.945744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27790fd0-5ee6-4367-966f-586587152eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:41.953098 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-27790fd0-5ee6-4367-966f-586587152eb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:38:41.954494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 83/164] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:38:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:41.959946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27790fd0-5ee6-4367-966f-586587152eb7 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:41.986822 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176970da-ae3d-4b6e-8482-376e5c5b9583 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:42.026073 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37a5e3-c68f-4289-bfef-f5011ba064b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:42.026913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37a5e3-c68f-4289-bfef-f5011ba064b3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.027204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37a5e3-c68f-4289-bfef-f5011ba064b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.027477 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37a5e3-c68f-4289-bfef-f5011ba064b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.056740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27790fd0-5ee6-4367-966f-586587152eb7 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:42.088195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc019c8-fc54-468d-8781-61a1da2761ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:42.088867 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc019c8-fc54-468d-8781-61a1da2761ff None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.089172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc019c8-fc54-468d-8781-61a1da2761ff None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.089449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc019c8-fc54-468d-8781-61a1da2761ff None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.090190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc019c8-fc54-468d-8781-61a1da2761ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:42.091662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc019c8-fc54-468d-8781-61a1da2761ff None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:42.095766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37a5e3-c68f-4289-bfef-f5011ba064b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:42.097245 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37a5e3-c68f-4289-bfef-f5011ba064b3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:42.110950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 84/165] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:38:41 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:42.111772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc019c8-fc54-468d-8781-61a1da2761ff None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:42.202036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 82/166] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:42.203346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef884d-7514-459b-8fe0-23b64e1e3ebd None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.203633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef884d-7514-459b-8fe0-23b64e1e3ebd None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.203906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef884d-7514-459b-8fe0-23b64e1e3ebd None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.205732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 83/167] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:42.214140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef884d-7514-459b-8fe0-23b64e1e3ebd None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:42.227677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc019c8-fc54-468d-8781-61a1da2761ff None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:42.261896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f73e9d-dcac-429a-a244-b6bd371d6bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:42.262627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f73e9d-dcac-429a-a244-b6bd371d6bd4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.262906 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f73e9d-dcac-429a-a244-b6bd371d6bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.263178 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f73e9d-dcac-429a-a244-b6bd371d6bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.263948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f73e9d-dcac-429a-a244-b6bd371d6bd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:42.264451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f73e9d-dcac-429a-a244-b6bd371d6bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:42.265763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f73e9d-dcac-429a-a244-b6bd371d6bd4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:42.274525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 85/168] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:38:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:42.276089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961c5dc-a796-4ba5-97b0-e0211c808585 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.276369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961c5dc-a796-4ba5-97b0-e0211c808585 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.276647 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961c5dc-a796-4ba5-97b0-e0211c808585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.293955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-e961c5dc-a796-4ba5-97b0-e0211c808585 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:42.295216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e961c5dc-a796-4ba5-97b0-e0211c808585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:42.322678 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef884d-7514-459b-8fe0-23b64e1e3ebd None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:42.358391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e0342-3b1d-45e9-ac9e-236def8edaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:42.359277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e0342-3b1d-45e9-ac9e-236def8edaea None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.359560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e0342-3b1d-45e9-ac9e-236def8edaea None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.359833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e0342-3b1d-45e9-ac9e-236def8edaea None admin] PATH_INFO: `/v3/projects/1ca33d16dc6f4018b10dc423d7b5ff07` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.361580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e0342-3b1d-45e9-ac9e-236def8edaea None admin] RBAC: Authorizing `identity:get_project(project_id=1ca33d16dc6f4018b10dc423d7b5ff07)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:42.362742 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e0342-3b1d-45e9-ac9e-236def8edaea None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:42.364757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 84/169] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:42 2022] GET /identity/v3/projects/1ca33d16dc6f4018b10dc423d7b5ff07 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:42.366114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e0342-3b1d-45e9-ac9e-236def8edaea None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:42.370577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 86/170] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:42.371554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961c5dc-a796-4ba5-97b0-e0211c808585 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:42.477835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961c5dc-a796-4ba5-97b0-e0211c808585 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:42.484592 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e0342-3b1d-45e9-ac9e-236def8edaea None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:42.515371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b82a6-0737-4138-a7f5-17154baf44e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:42.515990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b82a6-0737-4138-a7f5-17154baf44e1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.516268 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b82a6-0737-4138-a7f5-17154baf44e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.516540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b82a6-0737-4138-a7f5-17154baf44e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.517890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b82a6-0737-4138-a7f5-17154baf44e1 None admin] RBAC: Adding query filter params (role.id=20d2df2c0f34477d842f0e792557bb47, scope.project.id=1ca33d16dc6f4018b10dc423d7b5ff07, user.id=693008c321194ab9b799c5831e6413ab) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:42.518237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b82a6-0737-4138-a7f5-17154baf44e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:42.519831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b82a6-0737-4138-a7f5-17154baf44e1 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:42.519936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c522-04b2-420a-b4b7-f40972f110a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:42.520747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c522-04b2-420a-b4b7-f40972f110a5 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.521031 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c522-04b2-420a-b4b7-f40972f110a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.521308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c522-04b2-420a-b4b7-f40972f110a5 None admin] PATH_INFO: `/v3/users/693008c321194ab9b799c5831e6413ab` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.522558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851c522-04b2-420a-b4b7-f40972f110a5 None admin] RBAC: Authorizing `identity:get_user(user_id=693008c321194ab9b799c5831e6413ab)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:42.524069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851c522-04b2-420a-b4b7-f40972f110a5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:42.525731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 85/171] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:42 2022] GET /identity/v3/users/693008c321194ab9b799c5831e6413ab => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:42.526333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 87/172] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:42 2022] GET /identity/v3/role_assignments?user.id=693008c321194ab9b799c5831e6413ab&scope.project.id=1ca33d16dc6f4018b10dc423d7b5ff07&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:42.530132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c522-04b2-420a-b4b7-f40972f110a5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:42.532185 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b82a6-0737-4138-a7f5-17154baf44e1 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:42.650019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b82a6-0737-4138-a7f5-17154baf44e1 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:42.676460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c522-04b2-420a-b4b7-f40972f110a5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:42.697454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fedee-965a-40cc-92af-deeb0b24a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:42.698303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fedee-965a-40cc-92af-deeb0b24a66f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.698702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fedee-965a-40cc-92af-deeb0b24a66f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.698986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fedee-965a-40cc-92af-deeb0b24a66f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.720929 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54576bb-2e7e-4654-8a91-a6fe587a1a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:42.722157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54576bb-2e7e-4654-8a91-a6fe587a1a0d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.722635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54576bb-2e7e-4654-8a91-a6fe587a1a0d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.723098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54576bb-2e7e-4654-8a91-a6fe587a1a0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.735603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54576bb-2e7e-4654-8a91-a6fe587a1a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:42.744944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-c54576bb-2e7e-4654-8a91-a6fe587a1a0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:38:42.746912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 86/173] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:42.755136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54576bb-2e7e-4654-8a91-a6fe587a1a0d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:42.795286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fedee-965a-40cc-92af-deeb0b24a66f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:42.797117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fedee-965a-40cc-92af-deeb0b24a66f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:42.885341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54576bb-2e7e-4654-8a91-a6fe587a1a0d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:42.924873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cb140-3c2c-41f2-a318-fbcf9a2889e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:42.925909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cb140-3c2c-41f2-a318-fbcf9a2889e5 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:42.926422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cb140-3c2c-41f2-a318-fbcf9a2889e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:42.926941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cb140-3c2c-41f2-a318-fbcf9a2889e5 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:42.927890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cb140-3c2c-41f2-a318-fbcf9a2889e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:42.928384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cb140-3c2c-41f2-a318-fbcf9a2889e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:42.929985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cb140-3c2c-41f2-a318-fbcf9a2889e5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:42.931812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 88/174] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:42.938481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fedee-965a-40cc-92af-deeb0b24a66f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:42.940441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 87/175] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:42.946713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cb140-3c2c-41f2-a318-fbcf9a2889e5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:43.063963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cb140-3c2c-41f2-a318-fbcf9a2889e5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:43.107610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8de45e-7904-4516-b01a-9bd67d64fa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:43.108688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8de45e-7904-4516-b01a-9bd67d64fa7f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:43.109062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8de45e-7904-4516-b01a-9bd67d64fa7f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:43.109496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8de45e-7904-4516-b01a-9bd67d64fa7f None admin] PATH_INFO: `/v3/users/bcd9b0920f964f99bf20aef46afa8dad` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:43.112243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8de45e-7904-4516-b01a-9bd67d64fa7f None admin] RBAC: Authorizing `identity:get_user(user_id=bcd9b0920f964f99bf20aef46afa8dad)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:43.113885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8de45e-7904-4516-b01a-9bd67d64fa7f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:43.118776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 88/176] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:42 2022] GET /identity/v3/users/bcd9b0920f964f99bf20aef46afa8dad => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:43.123014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8de45e-7904-4516-b01a-9bd67d64fa7f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:43.156081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fedee-965a-40cc-92af-deeb0b24a66f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:43.207068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bf92c-736b-4b6b-8e6d-158514250962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:43.207950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bf92c-736b-4b6b-8e6d-158514250962 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:43.208225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bf92c-736b-4b6b-8e6d-158514250962 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:43.208493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bf92c-736b-4b6b-8e6d-158514250962 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:43.212451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bf92c-736b-4b6b-8e6d-158514250962 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:43.215151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bf92c-736b-4b6b-8e6d-158514250962 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:43.217988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 89/177] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:42 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:43.223970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bf92c-736b-4b6b-8e6d-158514250962 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:43.302573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8de45e-7904-4516-b01a-9bd67d64fa7f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:43.363543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2ed8-62b7-4329-ab1f-8b114dc832b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:43.364352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2ed8-62b7-4329-ab1f-8b114dc832b2 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:43.364634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2ed8-62b7-4329-ab1f-8b114dc832b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:43.364906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2ed8-62b7-4329-ab1f-8b114dc832b2 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:43.366468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad2ed8-62b7-4329-ab1f-8b114dc832b2 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:43.368169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad2ed8-62b7-4329-ab1f-8b114dc832b2 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:43.371231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 89/178] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:43 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:43.378410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2ed8-62b7-4329-ab1f-8b114dc832b2 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:43.384413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bf92c-736b-4b6b-8e6d-158514250962 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:43.448758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ac5cc-d420-4a4a-b9a4-2d74a9ce9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:43.449482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ac5cc-d420-4a4a-b9a4-2d74a9ce9180 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:43.449765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ac5cc-d420-4a4a-b9a4-2d74a9ce9180 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:43.450043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ac5cc-d420-4a4a-b9a4-2d74a9ce9180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:43.450917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ac5cc-d420-4a4a-b9a4-2d74a9ce9180 None admin] RBAC: Adding query filter params (role.id=23f476d154c04684802479843819b199, scope.project.id=1aca8b3a36e4474591361aeac183f0b4, user.id=693008c321194ab9b799c5831e6413ab) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:43.451226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ac5cc-d420-4a4a-b9a4-2d74a9ce9180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:43.452749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ac5cc-d420-4a4a-b9a4-2d74a9ce9180 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:43.459239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 90/179] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:43 2022] GET /identity/v3/role_assignments?user.id=693008c321194ab9b799c5831e6413ab&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=23f476d154c04684802479843819b199 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:43.552679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2ed8-62b7-4329-ab1f-8b114dc832b2 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:43.601435 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bc2a8-fbea-40d6-9925-5f22970ab86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:43.602399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc2a8-fbea-40d6-9925-5f22970ab86d None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:43.602674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc2a8-fbea-40d6-9925-5f22970ab86d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:43.602946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc2a8-fbea-40d6-9925-5f22970ab86d None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4/users/bcd9b0920f964f99bf20aef46afa8dad/roles/43312a4c8be340a889e15774cd34870a` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:43.605070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bc2a8-fbea-40d6-9925-5f22970ab86d None admin] RBAC: Authorizing `identity:create_grant(project_id=1aca8b3a36e4474591361aeac183f0b4, user_id=bcd9b0920f964f99bf20aef46afa8dad, role_id=43312a4c8be340a889e15774cd34870a)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:43.606662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bc2a8-fbea-40d6-9925-5f22970ab86d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:43.633141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 90/180] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:38:43 2022] PUT /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4/users/bcd9b0920f964f99bf20aef46afa8dad/roles/43312a4c8be340a889e15774cd34870a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:38:44.842537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20347be7-3289-4d89-be3a-b3344b5679af None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:44.843222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20347be7-3289-4d89-be3a-b3344b5679af None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:44.843222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20347be7-3289-4d89-be3a-b3344b5679af None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:44.844882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 91/181] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:44.850356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926618a-757d-406d-b7f8-bd7befc9ebcb None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:44.850852 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926618a-757d-406d-b7f8-bd7befc9ebcb None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:44.851001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926618a-757d-406d-b7f8-bd7befc9ebcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:44.868648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-5926618a-757d-406d-b7f8-bd7befc9ebcb None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:44.869875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5926618a-757d-406d-b7f8-bd7befc9ebcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:44.943729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 91/182] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:44.966783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20347be7-3289-4d89-be3a-b3344b5679af None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:45.064526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a64e7-0e53-4fff-9e63-15a0d0acd504 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.064526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a64e7-0e53-4fff-9e63-15a0d0acd504 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.064526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a64e7-0e53-4fff-9e63-15a0d0acd504 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.065995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20347be7-3289-4d89-be3a-b3344b5679af None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:45.066887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 92/183] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:38:45.072001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab0278-cfe1-4238-8986-b5f5091c9291 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.072507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab0278-cfe1-4238-8986-b5f5091c9291 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.072975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab0278-cfe1-4238-8986-b5f5091c9291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.091615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-cbab0278-cfe1-4238-8986-b5f5091c9291 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:45.092763 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cbab0278-cfe1-4238-8986-b5f5091c9291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:45.102857 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d7d40-014c-41a0-bae0-80d737aa8d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:45.104554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d7d40-014c-41a0-bae0-80d737aa8d11 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.105082 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d7d40-014c-41a0-bae0-80d737aa8d11 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.105563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d7d40-014c-41a0-bae0-80d737aa8d11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.119001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d7d40-014c-41a0-bae0-80d737aa8d11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:45.129210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-634d7d40-014c-41a0-bae0-80d737aa8d11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:38:45.130734 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 92/184] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:45.139209 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d7d40-014c-41a0-bae0-80d737aa8d11 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:45.160956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 93/185] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:38:45.184814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab0278-cfe1-4238-8986-b5f5091c9291 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:45.237167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d7d40-014c-41a0-bae0-80d737aa8d11 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:45.270294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c912eb-2835-4540-ae81-ba71050554f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:45.271304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c912eb-2835-4540-ae81-ba71050554f6 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.271304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c912eb-2835-4540-ae81-ba71050554f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.271482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c912eb-2835-4540-ae81-ba71050554f6 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.272249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c912eb-2835-4540-ae81-ba71050554f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:45.272554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c912eb-2835-4540-ae81-ba71050554f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:45.273942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c912eb-2835-4540-ae81-ba71050554f6 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:45.282478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 93/186] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:45.284144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab0278-cfe1-4238-8986-b5f5091c9291 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:45.288516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c912eb-2835-4540-ae81-ba71050554f6 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:45.320387 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e265e-e271-43b5-bac3-307fe9da822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:45.321216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e265e-e271-43b5-bac3-307fe9da822e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.321503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e265e-e271-43b5-bac3-307fe9da822e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.321784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e265e-e271-43b5-bac3-307fe9da822e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.331967 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e265e-e271-43b5-bac3-307fe9da822e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:45.339388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-5d3e265e-e271-43b5-bac3-307fe9da822e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:38:45.340615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 94/187] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:38:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:38:45.343415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24a6fe-842c-4c76-bbf0-c24ddec90b7f None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.343733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24a6fe-842c-4c76-bbf0-c24ddec90b7f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.344012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24a6fe-842c-4c76-bbf0-c24ddec90b7f None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.345838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 95/188] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:45.350712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24a6fe-842c-4c76-bbf0-c24ddec90b7f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:45.389035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c912eb-2835-4540-ae81-ba71050554f6 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:45.421340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5fc14-c3cd-40c4-9ddd-ae6addcc355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:45.422759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5fc14-c3cd-40c4-9ddd-ae6addcc355e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.423046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5fc14-c3cd-40c4-9ddd-ae6addcc355e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.423315 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5fc14-c3cd-40c4-9ddd-ae6addcc355e None admin] PATH_INFO: `/v3/users/e40e033892bd4f57abad3df12e6822a5` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.436165 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5fc14-c3cd-40c4-9ddd-ae6addcc355e None admin] RBAC: Authorizing `identity:get_user(user_id=e40e033892bd4f57abad3df12e6822a5)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:45.437638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5fc14-c3cd-40c4-9ddd-ae6addcc355e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:45.439387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 94/189] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:45 2022] GET /identity/v3/users/e40e033892bd4f57abad3df12e6822a5 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:45.445085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1d1ad-3c71-4562-98a5-971991414ff2 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.445375 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1d1ad-3c71-4562-98a5-971991414ff2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.445655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1d1ad-3c71-4562-98a5-971991414ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.454235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24a6fe-842c-4c76-bbf0-c24ddec90b7f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:45.462026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d1e1d1ad-3c71-4562-98a5-971991414ff2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:45.463244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d1e1d1ad-3c71-4562-98a5-971991414ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:45.488877 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c78c-328b-4a23-b960-608ac3afe1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:45.489653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c78c-328b-4a23-b960-608ac3afe1d8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.489943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c78c-328b-4a23-b960-608ac3afe1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.490270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c78c-328b-4a23-b960-608ac3afe1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.491029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c78c-328b-4a23-b960-608ac3afe1d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:45.491333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c78c-328b-4a23-b960-608ac3afe1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:45.492740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c78c-328b-4a23-b960-608ac3afe1d8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:45.500746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 96/190] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:38:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:45.504915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c78c-328b-4a23-b960-608ac3afe1d8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:45.531343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 95/191] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:45.543045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1d1ad-3c71-4562-98a5-971991414ff2 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:45.610520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c78c-328b-4a23-b960-608ac3afe1d8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:45.644440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63f258-104b-4573-adfe-506cb80a1f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:45.645033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63f258-104b-4573-adfe-506cb80a1f71 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.645327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63f258-104b-4573-adfe-506cb80a1f71 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.645616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63f258-104b-4573-adfe-506cb80a1f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.660549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1d1ad-3c71-4562-98a5-971991414ff2 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:45.694483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced9b31-5a3e-4a20-bf16-52cf7298d78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:45.695373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced9b31-5a3e-4a20-bf16-52cf7298d78a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.695650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced9b31-5a3e-4a20-bf16-52cf7298d78a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.695922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced9b31-5a3e-4a20-bf16-52cf7298d78a None admin] PATH_INFO: `/v3/users/e40e033892bd4f57abad3df12e6822a5` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.697214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced9b31-5a3e-4a20-bf16-52cf7298d78a None admin] RBAC: Authorizing `identity:get_user(user_id=e40e033892bd4f57abad3df12e6822a5)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:45.698790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced9b31-5a3e-4a20-bf16-52cf7298d78a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:45.700584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 96/192] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:45 2022] GET /identity/v3/users/e40e033892bd4f57abad3df12e6822a5 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:45.701116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced9b31-5a3e-4a20-bf16-52cf7298d78a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:45.717247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63f258-104b-4573-adfe-506cb80a1f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:45.719166 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63f258-104b-4573-adfe-506cb80a1f71 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:45.801987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced9b31-5a3e-4a20-bf16-52cf7298d78a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:45.821943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 97/193] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:45.823092 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63f258-104b-4573-adfe-506cb80a1f71 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:45.839111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd771c-782a-472c-97a1-e8e9bd081816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:45.840212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd771c-782a-472c-97a1-e8e9bd081816 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.840662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd771c-782a-472c-97a1-e8e9bd081816 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.841099 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd771c-782a-472c-97a1-e8e9bd081816 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.842487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd771c-782a-472c-97a1-e8e9bd081816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:45.844261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd771c-782a-472c-97a1-e8e9bd081816 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:45.845964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 97/194] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:45.846795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd771c-782a-472c-97a1-e8e9bd081816 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:45.924864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63f258-104b-4573-adfe-506cb80a1f71 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:45.940668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd771c-782a-472c-97a1-e8e9bd081816 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:45.957052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f14c9f-13f2-4db8-be52-56c109bf3434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:45.957713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f14c9f-13f2-4db8-be52-56c109bf3434 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.957994 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f14c9f-13f2-4db8-be52-56c109bf3434 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.958300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f14c9f-13f2-4db8-be52-56c109bf3434 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.973547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84482f2-d23b-4875-b180-dbd058acfd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:45.974542 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84482f2-d23b-4875-b180-dbd058acfd72 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:45.974822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84482f2-d23b-4875-b180-dbd058acfd72 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:45.975102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84482f2-d23b-4875-b180-dbd058acfd72 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:45.976278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84482f2-d23b-4875-b180-dbd058acfd72 None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:45.977738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84482f2-d23b-4875-b180-dbd058acfd72 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:45.984650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 98/195] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:45 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:45.984650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84482f2-d23b-4875-b180-dbd058acfd72 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:46.033880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f14c9f-13f2-4db8-be52-56c109bf3434 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:46.035649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f14c9f-13f2-4db8-be52-56c109bf3434 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:46.078865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84482f2-d23b-4875-b180-dbd058acfd72 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:46.110696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284852c-6475-4dd6-83b0-38e645b0f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:46.111375 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284852c-6475-4dd6-83b0-38e645b0f012 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:46.111657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284852c-6475-4dd6-83b0-38e645b0f012 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:46.111932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284852c-6475-4dd6-83b0-38e645b0f012 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:46.112647 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284852c-6475-4dd6-83b0-38e645b0f012 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:46.114133 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284852c-6475-4dd6-83b0-38e645b0f012 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:46.132516 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 98/196] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:46.133369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f14c9f-13f2-4db8-be52-56c109bf3434 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:46.133487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 99/197] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:38:45 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:46.134841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47396805-8ab8-4e00-b89d-ec791c3023b6 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:46.135127 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47396805-8ab8-4e00-b89d-ec791c3023b6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:46.135448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47396805-8ab8-4e00-b89d-ec791c3023b6 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:46.137406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 100/198] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:46.146320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47396805-8ab8-4e00-b89d-ec791c3023b6 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:46.243000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f14c9f-13f2-4db8-be52-56c109bf3434 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:46.246391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47396805-8ab8-4e00-b89d-ec791c3023b6 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:46.277784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20062095-df2b-49c6-988b-5fc8008aa2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:46.278503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20062095-df2b-49c6-988b-5fc8008aa2ac None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:46.278787 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20062095-df2b-49c6-988b-5fc8008aa2ac None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:46.279068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20062095-df2b-49c6-988b-5fc8008aa2ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:46.279918 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20062095-df2b-49c6-988b-5fc8008aa2ac None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=13447c6176fd4fe4bc3cd6079394899c, user.id=e40e033892bd4f57abad3df12e6822a5) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:46.280182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac03364-d466-4c5c-9029-56c01f6f6f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:46.280295 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20062095-df2b-49c6-988b-5fc8008aa2ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:46.281065 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03364-d466-4c5c-9029-56c01f6f6f0d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:46.281393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03364-d466-4c5c-9029-56c01f6f6f0d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:46.281662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03364-d466-4c5c-9029-56c01f6f6f0d None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:46.281822 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20062095-df2b-49c6-988b-5fc8008aa2ac None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:46.282944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac03364-d466-4c5c-9029-56c01f6f6f0d None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:46.284420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac03364-d466-4c5c-9029-56c01f6f6f0d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:46.291488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 101/199] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:46 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:46.291488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc47b9-72eb-4c9a-a523-08231c76148b None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:46.291488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc47b9-72eb-4c9a-a523-08231c76148b None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:46.291488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc47b9-72eb-4c9a-a523-08231c76148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:46.291852 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 99/200] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:46 2022] GET /identity/v3/role_assignments?user.id=e40e033892bd4f57abad3df12e6822a5&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:46.292412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20062095-df2b-49c6-988b-5fc8008aa2ac None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:46.317720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f4bc47b9-72eb-4c9a-a523-08231c76148b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:46.319660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f4bc47b9-72eb-4c9a-a523-08231c76148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:46.404521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20062095-df2b-49c6-988b-5fc8008aa2ac None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:46.408795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 102/201] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:46.433040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc47b9-72eb-4c9a-a523-08231c76148b None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:46.442128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14269eb3-d252-4510-b404-f9fe00fd7b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:46.442863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14269eb3-d252-4510-b404-f9fe00fd7b00 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:46.443145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14269eb3-d252-4510-b404-f9fe00fd7b00 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:46.443416 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14269eb3-d252-4510-b404-f9fe00fd7b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:46.444263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14269eb3-d252-4510-b404-f9fe00fd7b00 None admin] RBAC: Adding query filter params (role.id=23f476d154c04684802479843819b199, scope.project.id=13447c6176fd4fe4bc3cd6079394899c, user.id=e40e033892bd4f57abad3df12e6822a5) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:46.444571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14269eb3-d252-4510-b404-f9fe00fd7b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:46.446058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14269eb3-d252-4510-b404-f9fe00fd7b00 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:46.452692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 100/202] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:46 2022] GET /identity/v3/role_assignments?user.id=e40e033892bd4f57abad3df12e6822a5&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=23f476d154c04684802479843819b199 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:46.554537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc47b9-72eb-4c9a-a523-08231c76148b None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:46.593765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00a299-0784-4434-819f-6ddc53bba59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:46.594714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a299-0784-4434-819f-6ddc53bba59b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:46.594994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a299-0784-4434-819f-6ddc53bba59b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:46.595268 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a299-0784-4434-819f-6ddc53bba59b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:46.608024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00a299-0784-4434-819f-6ddc53bba59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:46.615401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-de00a299-0784-4434-819f-6ddc53bba59b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:38:46.616702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 103/203] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:38:46.623008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14269eb3-d252-4510-b404-f9fe00fd7b00 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:46.730457 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14269eb3-d252-4510-b404-f9fe00fd7b00 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:46.769113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810687e-b48a-427c-b2c9-3b74c9322c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:46.769794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810687e-b48a-427c-b2c9-3b74c9322c6f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:46.770089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810687e-b48a-427c-b2c9-3b74c9322c6f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:46.770383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810687e-b48a-427c-b2c9-3b74c9322c6f None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:46.771138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810687e-b48a-427c-b2c9-3b74c9322c6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:46.771440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810687e-b48a-427c-b2c9-3b74c9322c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:46.772827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810687e-b48a-427c-b2c9-3b74c9322c6f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:46.781546 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 101/204] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:46.791402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00a299-0784-4434-819f-6ddc53bba59b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:46.916359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00a299-0784-4434-819f-6ddc53bba59b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:46.958773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f818181-e947-482c-bb59-781d7288903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:46.959667 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f818181-e947-482c-bb59-781d7288903b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:46.959946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f818181-e947-482c-bb59-781d7288903b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:46.960217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f818181-e947-482c-bb59-781d7288903b None admin] PATH_INFO: `/v3/users/bcd9b0920f964f99bf20aef46afa8dad` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:46.961435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f818181-e947-482c-bb59-781d7288903b None admin] RBAC: Authorizing `identity:get_user(user_id=bcd9b0920f964f99bf20aef46afa8dad)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:46.962936 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f818181-e947-482c-bb59-781d7288903b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:46.964739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 104/205] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:46 2022] GET /identity/v3/users/bcd9b0920f964f99bf20aef46afa8dad => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:46.970288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810687e-b48a-427c-b2c9-3b74c9322c6f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:47.077416 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810687e-b48a-427c-b2c9-3b74c9322c6f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:47.117900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5da37d-5672-46a8-b96f-8fefe1c01f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:47.118612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5da37d-5672-46a8-b96f-8fefe1c01f1b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:47.118901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5da37d-5672-46a8-b96f-8fefe1c01f1b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:47.119178 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5da37d-5672-46a8-b96f-8fefe1c01f1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:47.185492 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5da37d-5672-46a8-b96f-8fefe1c01f1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:47.187019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5da37d-5672-46a8-b96f-8fefe1c01f1b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:47.283451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 102/206] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:47.291196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f818181-e947-482c-bb59-781d7288903b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:47.413290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f818181-e947-482c-bb59-781d7288903b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:47.446548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83935-9cf0-4e01-b149-91c91ae3da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:47.447435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83935-9cf0-4e01-b149-91c91ae3da6b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:47.447713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83935-9cf0-4e01-b149-91c91ae3da6b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:47.447976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83935-9cf0-4e01-b149-91c91ae3da6b None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:47.449175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c83935-9cf0-4e01-b149-91c91ae3da6b None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:47.450672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c83935-9cf0-4e01-b149-91c91ae3da6b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:47.452562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 105/207] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:47 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:47.458573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5da37d-5672-46a8-b96f-8fefe1c01f1b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:47.586419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5da37d-5672-46a8-b96f-8fefe1c01f1b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:47.633075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319c713-341c-4a6e-b156-b6bac62f9218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:47.633749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c713-341c-4a6e-b156-b6bac62f9218 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:47.634037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c713-341c-4a6e-b156-b6bac62f9218 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:47.634334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c713-341c-4a6e-b156-b6bac62f9218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:47.635175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319c713-341c-4a6e-b156-b6bac62f9218 None admin] RBAC: Adding query filter params (role.id=43312a4c8be340a889e15774cd34870a, scope.project.id=1aca8b3a36e4474591361aeac183f0b4, user.id=bcd9b0920f964f99bf20aef46afa8dad) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:47.635485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319c713-341c-4a6e-b156-b6bac62f9218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:47.636972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319c713-341c-4a6e-b156-b6bac62f9218 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:47.653255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 103/208] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:47 2022] GET /identity/v3/role_assignments?user.id=bcd9b0920f964f99bf20aef46afa8dad&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=43312a4c8be340a889e15774cd34870a => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:48.948998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a670ae-eaa2-40c1-a8e4-315299601f30 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:48.949695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a670ae-eaa2-40c1-a8e4-315299601f30 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:48.949695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a670ae-eaa2-40c1-a8e4-315299601f30 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:48.951528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 106/209] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:48.957218 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3c7e-6db8-43e8-86cd-d4ec88a90cc2 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:48.957707 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3c7e-6db8-43e8-86cd-d4ec88a90cc2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:48.957849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3c7e-6db8-43e8-86cd-d4ec88a90cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:48.975017 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-924a3c7e-6db8-43e8-86cd-d4ec88a90cc2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:48.976197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-924a3c7e-6db8-43e8-86cd-d4ec88a90cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:49.042596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 104/210] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:49.065846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a670ae-eaa2-40c1-a8e4-315299601f30 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.110937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3aff43-c28a-45b6-8939-075202a6f0d2 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.111260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3aff43-c28a-45b6-8939-075202a6f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.111480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3aff43-c28a-45b6-8939-075202a6f0d2 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.113287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 105/211] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:38:49.114403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5ff8-8f2b-4693-b25b-6b343b6fb679 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.114681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5ff8-8f2b-4693-b25b-6b343b6fb679 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.114958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5ff8-8f2b-4693-b25b-6b343b6fb679 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.116539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 106/212] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:49.118734 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb2e0-2de9-42c0-bfed-51bb1b02a593 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.119024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb2e0-2de9-42c0-bfed-51bb1b02a593 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.119301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb2e0-2de9-42c0-bfed-51bb1b02a593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.136435 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b12fb2e0-2de9-42c0-bfed-51bb1b02a593 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:49.137612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b12fb2e0-2de9-42c0-bfed-51bb1b02a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:49.167941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a670ae-eaa2-40c1-a8e4-315299601f30 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:49.200449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa247cc-78d7-4dad-909a-75dac77b4f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:49.201275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa247cc-78d7-4dad-909a-75dac77b4f44 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.201563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa247cc-78d7-4dad-909a-75dac77b4f44 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.201837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa247cc-78d7-4dad-909a-75dac77b4f44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.202479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 107/213] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:38:49.206385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5807eec-90a1-411b-a00d-2c9e4d3a6b2f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.206385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5807eec-90a1-411b-a00d-2c9e4d3a6b2f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.206385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5807eec-90a1-411b-a00d-2c9e4d3a6b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.216145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa247cc-78d7-4dad-909a-75dac77b4f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:49.223376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-3fa247cc-78d7-4dad-909a-75dac77b4f44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:38:49.224611 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 107/214] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:49.226902 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-a5807eec-90a1-411b-a00d-2c9e4d3a6b2f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:49.228271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a5807eec-90a1-411b-a00d-2c9e4d3a6b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:49.230362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa247cc-78d7-4dad-909a-75dac77b4f44 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.291190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 108/215] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:49.292524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5807eec-90a1-411b-a00d-2c9e4d3a6b2f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.329942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa247cc-78d7-4dad-909a-75dac77b4f44 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:49.361714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f85089-73ee-441e-98b2-e2b578259663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:49.362525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f85089-73ee-441e-98b2-e2b578259663 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.362798 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f85089-73ee-441e-98b2-e2b578259663 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.363061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f85089-73ee-441e-98b2-e2b578259663 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.372604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f85089-73ee-441e-98b2-e2b578259663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:49.379652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-38f85089-73ee-441e-98b2-e2b578259663 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:38:49.380858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 108/216] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:38:49.385896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ac849-63a0-45de-bc12-a4e362a80682 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.385896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ac849-63a0-45de-bc12-a4e362a80682 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.385896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ac849-63a0-45de-bc12-a4e362a80682 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.385896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 109/217] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:49.385896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ac849-63a0-45de-bc12-a4e362a80682 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.390482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5807eec-90a1-411b-a00d-2c9e4d3a6b2f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:49.423118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad992705-bb27-491a-924d-c5853d9f71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:49.423779 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992705-bb27-491a-924d-c5853d9f71bb None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.424057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992705-bb27-491a-924d-c5853d9f71bb None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.424333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992705-bb27-491a-924d-c5853d9f71bb None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.425083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad992705-bb27-491a-924d-c5853d9f71bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:49.425383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad992705-bb27-491a-924d-c5853d9f71bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:49.426826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad992705-bb27-491a-924d-c5853d9f71bb None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:49.434578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 109/218] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:49.435426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad992705-bb27-491a-924d-c5853d9f71bb None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.485278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ac849-63a0-45de-bc12-a4e362a80682 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:49.517847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ecacd-6f73-4467-bdfb-e5a92acbb4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:49.519010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ecacd-6f73-4467-bdfb-e5a92acbb4f6 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.519296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ecacd-6f73-4467-bdfb-e5a92acbb4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.519570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ecacd-6f73-4467-bdfb-e5a92acbb4f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.520755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ecacd-6f73-4467-bdfb-e5a92acbb4f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:49.522265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ecacd-6f73-4467-bdfb-e5a92acbb4f6 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:49.523913 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 110/219] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:49.525127 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d9b5-ddda-46bb-a34b-1ef28bb6d9fd None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.525345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d9b5-ddda-46bb-a34b-1ef28bb6d9fd None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.525641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d9b5-ddda-46bb-a34b-1ef28bb6d9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.528081 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad992705-bb27-491a-924d-c5853d9f71bb None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:49.541790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-3ee0d9b5-ddda-46bb-a34b-1ef28bb6d9fd None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:49.543012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3ee0d9b5-ddda-46bb-a34b-1ef28bb6d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:49.561811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67285a-b42c-4796-8048-15885e26adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:49.562511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67285a-b42c-4796-8048-15885e26adda None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.562828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67285a-b42c-4796-8048-15885e26adda None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.563103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67285a-b42c-4796-8048-15885e26adda None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.563837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67285a-b42c-4796-8048-15885e26adda None admin] RBAC: Adding query filter params (name=member) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:49.564135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67285a-b42c-4796-8048-15885e26adda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:49.565529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67285a-b42c-4796-8048-15885e26adda None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:49.574471 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 110/220] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:49.575242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67285a-b42c-4796-8048-15885e26adda None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.608607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 111/221] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:49.609475 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0d9b5-ddda-46bb-a34b-1ef28bb6d9fd None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.675367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67285a-b42c-4796-8048-15885e26adda None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:49.705755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0d9b5-ddda-46bb-a34b-1ef28bb6d9fd None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:49.707052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201918-5bb3-4fdc-96e1-58c1d4b54f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:49.707950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201918-5bb3-4fdc-96e1-58c1d4b54f70 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.708206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201918-5bb3-4fdc-96e1-58c1d4b54f70 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.708489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201918-5bb3-4fdc-96e1-58c1d4b54f70 None admin] PATH_INFO: `/v3/users/e40e033892bd4f57abad3df12e6822a5` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.709824 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b201918-5bb3-4fdc-96e1-58c1d4b54f70 None admin] RBAC: Authorizing `identity:get_user(user_id=e40e033892bd4f57abad3df12e6822a5)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:49.711528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b201918-5bb3-4fdc-96e1-58c1d4b54f70 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:49.713478 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 111/222] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:49 2022] GET /identity/v3/users/e40e033892bd4f57abad3df12e6822a5 => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:49.718962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201918-5bb3-4fdc-96e1-58c1d4b54f70 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.738839 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6a53-cd21-4d97-8f00-c791f0c9afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:49.739454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6a53-cd21-4d97-8f00-c791f0c9afcf None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.739726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6a53-cd21-4d97-8f00-c791f0c9afcf None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.739981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6a53-cd21-4d97-8f00-c791f0c9afcf None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.740687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb6a53-cd21-4d97-8f00-c791f0c9afcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:49.742256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb6a53-cd21-4d97-8f00-c791f0c9afcf None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:49.762254 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 112/223] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:38:49 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:49.767136 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6a53-cd21-4d97-8f00-c791f0c9afcf None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.821374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201918-5bb3-4fdc-96e1-58c1d4b54f70 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:49.857515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f1887-850f-4ca0-8b61-5d248d8f59ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:49.858426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f1887-850f-4ca0-8b61-5d248d8f59ff None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.858719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f1887-850f-4ca0-8b61-5d248d8f59ff None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.858976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f1887-850f-4ca0-8b61-5d248d8f59ff None admin] PATH_INFO: `/v3/users/e3fe18d8fcab438a8b415ab98f1eca46` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.873149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f1887-850f-4ca0-8b61-5d248d8f59ff None admin] RBAC: Authorizing `identity:get_user(user_id=e3fe18d8fcab438a8b415ab98f1eca46)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:49.873360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6a53-cd21-4d97-8f00-c791f0c9afcf None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:49.874693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f1887-850f-4ca0-8b61-5d248d8f59ff None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:49.876808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 112/224] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:49 2022] GET /identity/v3/users/e3fe18d8fcab438a8b415ab98f1eca46 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:49.877621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f1887-850f-4ca0-8b61-5d248d8f59ff None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.910476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c44601-8cb0-453a-9803-f5ed001a5ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:49.911300 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c44601-8cb0-453a-9803-f5ed001a5ffc None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:49.911582 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c44601-8cb0-453a-9803-f5ed001a5ffc None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:49.911851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c44601-8cb0-453a-9803-f5ed001a5ffc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:49.923608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c44601-8cb0-453a-9803-f5ed001a5ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:49.931342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-72c44601-8cb0-453a-9803-f5ed001a5ffc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:38:49.937417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 113/225] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:38:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:49.937417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c44601-8cb0-453a-9803-f5ed001a5ffc None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:49.984556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f1887-850f-4ca0-8b61-5d248d8f59ff None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:50.018649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734a153-cae2-448c-9495-2bb9158ad20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:50.019868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734a153-cae2-448c-9495-2bb9158ad20d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:50.020149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734a153-cae2-448c-9495-2bb9158ad20d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:50.020423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734a153-cae2-448c-9495-2bb9158ad20d None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:50.021732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734a153-cae2-448c-9495-2bb9158ad20d None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:50.024564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734a153-cae2-448c-9495-2bb9158ad20d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:50.027562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 113/226] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:49 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:50.027562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734a153-cae2-448c-9495-2bb9158ad20d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:50.038058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c44601-8cb0-453a-9803-f5ed001a5ffc None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:50.073057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6dedc-a32e-4afa-b647-1ac23ce780a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:50.073755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6dedc-a32e-4afa-b647-1ac23ce780a4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:50.074158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6dedc-a32e-4afa-b647-1ac23ce780a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:50.074436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6dedc-a32e-4afa-b647-1ac23ce780a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:50.131310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734a153-cae2-448c-9495-2bb9158ad20d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:50.145627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6dedc-a32e-4afa-b647-1ac23ce780a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:50.146899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6dedc-a32e-4afa-b647-1ac23ce780a4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:50.165457 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0aef-358c-483b-8030-08a0d157b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:50.166516 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0aef-358c-483b-8030-08a0d157b13a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:50.166954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0aef-358c-483b-8030-08a0d157b13a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:50.167363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0aef-358c-483b-8030-08a0d157b13a None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:50.168266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e0aef-358c-483b-8030-08a0d157b13a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:50.168718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e0aef-358c-483b-8030-08a0d157b13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:50.170142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e0aef-358c-483b-8030-08a0d157b13a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:50.181036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 114/227] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:38:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:50.182248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0aef-358c-483b-8030-08a0d157b13a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:50.249753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 114/228] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:50.250732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6dedc-a32e-4afa-b647-1ac23ce780a4 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:50.289805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0aef-358c-483b-8030-08a0d157b13a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:50.324616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e04da0-51b9-4660-adc6-3d3b7764e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:50.325807 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04da0-51b9-4660-adc6-3d3b7764e5c6 None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:50.326274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04da0-51b9-4660-adc6-3d3b7764e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:50.326708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04da0-51b9-4660-adc6-3d3b7764e5c6 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c/users/e40e033892bd4f57abad3df12e6822a5/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:50.328876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e04da0-51b9-4660-adc6-3d3b7764e5c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=13447c6176fd4fe4bc3cd6079394899c, user_id=e40e033892bd4f57abad3df12e6822a5, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:50.330530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e04da0-51b9-4660-adc6-3d3b7764e5c6 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:50.352076 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 115/229] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:38:50 2022] PUT /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c/users/e40e033892bd4f57abad3df12e6822a5/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:38:50.352076 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e04da0-51b9-4660-adc6-3d3b7764e5c6 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:50.356891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6dedc-a32e-4afa-b647-1ac23ce780a4 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:50.435769 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97d1fa-52a2-474d-a13b-d90a1f3d1271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:50.437061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97d1fa-52a2-474d-a13b-d90a1f3d1271 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:50.437337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97d1fa-52a2-474d-a13b-d90a1f3d1271 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:50.437618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97d1fa-52a2-474d-a13b-d90a1f3d1271 None admin] PATH_INFO: `/v3/users/e40e033892bd4f57abad3df12e6822a5` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:50.439294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97d1fa-52a2-474d-a13b-d90a1f3d1271 None admin] RBAC: Authorizing `identity:get_user(user_id=e40e033892bd4f57abad3df12e6822a5)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:50.441144 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97d1fa-52a2-474d-a13b-d90a1f3d1271 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:50.443047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 115/230] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:50 2022] GET /identity/v3/users/e40e033892bd4f57abad3df12e6822a5 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:50.449251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97d1fa-52a2-474d-a13b-d90a1f3d1271 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:50.547675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e04da0-51b9-4660-adc6-3d3b7764e5c6 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:50.607973 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b045c16-26ba-4872-ac67-5118f840e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:50.608878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045c16-26ba-4872-ac67-5118f840e49e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:50.609153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045c16-26ba-4872-ac67-5118f840e49e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:50.609476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045c16-26ba-4872-ac67-5118f840e49e None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:50.611667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b045c16-26ba-4872-ac67-5118f840e49e None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:50.613158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b045c16-26ba-4872-ac67-5118f840e49e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:50.615075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 116/231] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:50 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:50.618436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97d1fa-52a2-474d-a13b-d90a1f3d1271 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:50.620745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b045c16-26ba-4872-ac67-5118f840e49e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:50.672129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d823b-b677-4963-82b5-4514c524bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:50.673119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d823b-b677-4963-82b5-4514c524bb5a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:50.673392 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d823b-b677-4963-82b5-4514c524bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:50.673655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d823b-b677-4963-82b5-4514c524bb5a None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:50.674874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d823b-b677-4963-82b5-4514c524bb5a None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:50.676325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d823b-b677-4963-82b5-4514c524bb5a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:50.678015 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 116/232] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:50 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:50.683884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d823b-b677-4963-82b5-4514c524bb5a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:50.782640 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d823b-b677-4963-82b5-4514c524bb5a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:50.816721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68390b29-f9fb-4b70-b677-29c63d676d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:50.817549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68390b29-f9fb-4b70-b677-29c63d676d00 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:50.817824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68390b29-f9fb-4b70-b677-29c63d676d00 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:50.818108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68390b29-f9fb-4b70-b677-29c63d676d00 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c/users/e40e033892bd4f57abad3df12e6822a5/roles/23f476d154c04684802479843819b199` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:50.820327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68390b29-f9fb-4b70-b677-29c63d676d00 None admin] RBAC: Authorizing `identity:create_grant(project_id=13447c6176fd4fe4bc3cd6079394899c, user_id=e40e033892bd4f57abad3df12e6822a5, role_id=23f476d154c04684802479843819b199)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:50.821794 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68390b29-f9fb-4b70-b677-29c63d676d00 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:50.838154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b045c16-26ba-4872-ac67-5118f840e49e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:50.841843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 117/233] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:38:50 2022] PUT /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c/users/e40e033892bd4f57abad3df12e6822a5/roles/23f476d154c04684802479843819b199 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:38:50.888641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0fc52-5dfd-4719-8bf1-7c57ae688789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:50.889328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0fc52-5dfd-4719-8bf1-7c57ae688789 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:50.889608 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0fc52-5dfd-4719-8bf1-7c57ae688789 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:50.891820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0fc52-5dfd-4719-8bf1-7c57ae688789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:50.891820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0fc52-5dfd-4719-8bf1-7c57ae688789 None admin] RBAC: Adding query filter params (role.id=20d2df2c0f34477d842f0e792557bb47, scope.project.id=13447c6176fd4fe4bc3cd6079394899c, user.id=e3fe18d8fcab438a8b415ab98f1eca46) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:50.891820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0fc52-5dfd-4719-8bf1-7c57ae688789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:50.892619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0fc52-5dfd-4719-8bf1-7c57ae688789 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:50.909730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 117/234] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:50 2022] GET /identity/v3/role_assignments?user.id=e3fe18d8fcab438a8b415ab98f1eca46&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:52.598572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754b508-517e-46de-9477-8afe689a7d41 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:52.599279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754b508-517e-46de-9477-8afe689a7d41 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:52.599279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754b508-517e-46de-9477-8afe689a7d41 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:52.601173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 118/235] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:52.606533 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bae31-a9bc-46e3-8a10-0efac0ee0324 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:52.606996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bae31-a9bc-46e3-8a10-0efac0ee0324 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:52.607142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bae31-a9bc-46e3-8a10-0efac0ee0324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:52.623516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1f8e2-8815-405d-b644-a0b25e491efe None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:52.623790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1f8e2-8815-405d-b644-a0b25e491efe None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:52.624056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1f8e2-8815-405d-b644-a0b25e491efe None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:52.625885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 119/236] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:38:52.631533 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec021e-7a3e-4d8b-9532-877797a5e092 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:52.631818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec021e-7a3e-4d8b-9532-877797a5e092 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:52.632104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec021e-7a3e-4d8b-9532-877797a5e092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:52.640465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-8f0bae31-a9bc-46e3-8a10-0efac0ee0324 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:52.640465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8f0bae31-a9bc-46e3-8a10-0efac0ee0324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:52.650391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-48ec021e-7a3e-4d8b-9532-877797a5e092 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:52.651590 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-48ec021e-7a3e-4d8b-9532-877797a5e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:52.730201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 120/237] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:38:52.750307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec021e-7a3e-4d8b-9532-877797a5e092 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:52.780390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 118/238] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:52.824958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bae31-a9bc-46e3-8a10-0efac0ee0324 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:52.851953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec021e-7a3e-4d8b-9532-877797a5e092 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:52.888371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1480c-420a-425e-9430-92323dad0dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:52.889197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1480c-420a-425e-9430-92323dad0dd1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:52.889477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1480c-420a-425e-9430-92323dad0dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:52.889749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1480c-420a-425e-9430-92323dad0dd1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:52.901837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1480c-420a-425e-9430-92323dad0dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:52.909000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-46d1480c-420a-425e-9430-92323dad0dd1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:38:52.914203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 121/239] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:38:52.916326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1480c-420a-425e-9430-92323dad0dd1 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:53.014401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1480c-420a-425e-9430-92323dad0dd1 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:53.047792 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816dfb3-cfbb-4653-8049-b48c0e943961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:53.048471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816dfb3-cfbb-4653-8049-b48c0e943961 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.048755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816dfb3-cfbb-4653-8049-b48c0e943961 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.049030 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816dfb3-cfbb-4653-8049-b48c0e943961 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.049783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816dfb3-cfbb-4653-8049-b48c0e943961 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:53.050112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816dfb3-cfbb-4653-8049-b48c0e943961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:53.051514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816dfb3-cfbb-4653-8049-b48c0e943961 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:53.059786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 122/240] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:53.065471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816dfb3-cfbb-4653-8049-b48c0e943961 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:53.072034 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bae31-a9bc-46e3-8a10-0efac0ee0324 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:53.118384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294f49d-fba2-434d-8088-9f5159dfed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:53.119280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f49d-fba2-434d-8088-9f5159dfed61 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.119566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f49d-fba2-434d-8088-9f5159dfed61 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.120164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f49d-fba2-434d-8088-9f5159dfed61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.121614 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294f49d-fba2-434d-8088-9f5159dfed61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:53.123836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294f49d-fba2-434d-8088-9f5159dfed61 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:53.126493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 119/241] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:53.131714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294f49d-fba2-434d-8088-9f5159dfed61 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:53.203103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816dfb3-cfbb-4653-8049-b48c0e943961 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:53.268723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611532f9-76fc-4bcd-bad0-d0d85d04cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:53.269621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611532f9-76fc-4bcd-bad0-d0d85d04cac3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.269897 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611532f9-76fc-4bcd-bad0-d0d85d04cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.270198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611532f9-76fc-4bcd-bad0-d0d85d04cac3 None admin] PATH_INFO: `/v3/users/86ad662f809a4cdbbc645bcff0e22e3e` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.278447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294f49d-fba2-434d-8088-9f5159dfed61 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:53.285052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611532f9-76fc-4bcd-bad0-d0d85d04cac3 None admin] RBAC: Authorizing `identity:get_user(user_id=86ad662f809a4cdbbc645bcff0e22e3e)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:53.286590 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611532f9-76fc-4bcd-bad0-d0d85d04cac3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:53.288330 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 123/242] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:53 2022] GET /identity/v3/users/86ad662f809a4cdbbc645bcff0e22e3e => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:53.294376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dc5b9-1b72-4b68-8883-6407965eac52 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.294376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dc5b9-1b72-4b68-8883-6407965eac52 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.294589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dc5b9-1b72-4b68-8883-6407965eac52 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.296386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 124/243] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:53.301462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dc5b9-1b72-4b68-8883-6407965eac52 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:53.321848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb01b56-4763-41aa-b83e-44abfe5653c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:53.323080 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01b56-4763-41aa-b83e-44abfe5653c0 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.323664 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01b56-4763-41aa-b83e-44abfe5653c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.324110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01b56-4763-41aa-b83e-44abfe5653c0 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.325306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb01b56-4763-41aa-b83e-44abfe5653c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:53.327038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb01b56-4763-41aa-b83e-44abfe5653c0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:53.357630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 120/244] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:38:53 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:53.359740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf281d-a794-4d08-9279-c341a0ea5983 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.360560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf281d-a794-4d08-9279-c341a0ea5983 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.361014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf281d-a794-4d08-9279-c341a0ea5983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.390392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1adf281d-a794-4d08-9279-c341a0ea5983 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:53.393207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1adf281d-a794-4d08-9279-c341a0ea5983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:53.474183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dc5b9-1b72-4b68-8883-6407965eac52 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:53.512428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78da10a-5c1d-4c29-8408-b7a4c27b581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:53.513446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78da10a-5c1d-4c29-8408-b7a4c27b581d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.513893 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78da10a-5c1d-4c29-8408-b7a4c27b581d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.514368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78da10a-5c1d-4c29-8408-b7a4c27b581d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.572425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 121/245] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:53.585305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78da10a-5c1d-4c29-8408-b7a4c27b581d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:53.587080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78da10a-5c1d-4c29-8408-b7a4c27b581d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:53.598880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf281d-a794-4d08-9279-c341a0ea5983 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:53.687067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 125/246] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:53.695037 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78da10a-5c1d-4c29-8408-b7a4c27b581d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:53.721443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf281d-a794-4d08-9279-c341a0ea5983 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:53.765896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afd3ad-0624-4680-a886-df9670653d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:53.766816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afd3ad-0624-4680-a886-df9670653d13 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.767093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afd3ad-0624-4680-a886-df9670653d13 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.767362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afd3ad-0624-4680-a886-df9670653d13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.779732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afd3ad-0624-4680-a886-df9670653d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:53.787219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-d2afd3ad-0624-4680-a886-df9670653d13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:38:53.788811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 122/247] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:38:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:38:53.794902 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afd3ad-0624-4680-a886-df9670653d13 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:53.807078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78da10a-5c1d-4c29-8408-b7a4c27b581d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:53.859651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adde57-4201-4cb1-95ec-c52081df9f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:53.861017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adde57-4201-4cb1-95ec-c52081df9f08 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.861299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adde57-4201-4cb1-95ec-c52081df9f08 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.861567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adde57-4201-4cb1-95ec-c52081df9f08 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.863112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adde57-4201-4cb1-95ec-c52081df9f08 None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:53.864849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adde57-4201-4cb1-95ec-c52081df9f08 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:53.867732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 126/248] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:53 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:53.869140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10884d5-6e2b-4a15-8269-10958d54fde8 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.869706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10884d5-6e2b-4a15-8269-10958d54fde8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.869979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10884d5-6e2b-4a15-8269-10958d54fde8 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.871898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 127/249] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:53.876613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10884d5-6e2b-4a15-8269-10958d54fde8 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:53.935532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afd3ad-0624-4680-a886-df9670653d13 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:53.974449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c59ef6-f5e0-4727-bd8f-b888cc0e5ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:53.975101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59ef6-f5e0-4727-bd8f-b888cc0e5ab0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.975374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59ef6-f5e0-4727-bd8f-b888cc0e5ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.975662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59ef6-f5e0-4727-bd8f-b888cc0e5ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.976430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c59ef6-f5e0-4727-bd8f-b888cc0e5ab0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:53.976729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c59ef6-f5e0-4727-bd8f-b888cc0e5ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:53.978129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c59ef6-f5e0-4727-bd8f-b888cc0e5ab0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:53.992141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 123/250] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:53.992141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37846-6bb9-4a87-a6ca-b9c88951c02a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:53.992141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37846-6bb9-4a87-a6ca-b9c88951c02a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:53.992141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37846-6bb9-4a87-a6ca-b9c88951c02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:53.996950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10884d5-6e2b-4a15-8269-10958d54fde8 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:54.010116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-cce37846-6bb9-4a87-a6ca-b9c88951c02a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:54.011302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cce37846-6bb9-4a87-a6ca-b9c88951c02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:54.033846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecdcfc-7a08-4e19-bae2-5311c9ff2ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:54.034470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdcfc-7a08-4e19-bae2-5311c9ff2ca2 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:54.034748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdcfc-7a08-4e19-bae2-5311c9ff2ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:54.035014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdcfc-7a08-4e19-bae2-5311c9ff2ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:54.035927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecdcfc-7a08-4e19-bae2-5311c9ff2ca2 None admin] RBAC: Adding query filter params (role.id=43312a4c8be340a889e15774cd34870a, scope.project.id=13447c6176fd4fe4bc3cd6079394899c, user.id=86ad662f809a4cdbbc645bcff0e22e3e) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:54.036143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecdcfc-7a08-4e19-bae2-5311c9ff2ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:54.037670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecdcfc-7a08-4e19-bae2-5311c9ff2ca2 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:54.043757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 128/251] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:53 2022] GET /identity/v3/role_assignments?user.id=86ad662f809a4cdbbc645bcff0e22e3e&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=43312a4c8be340a889e15774cd34870a => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:54.045186 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ec60-609f-48a1-9026-a20dd0886004 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:54.045471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ec60-609f-48a1-9026-a20dd0886004 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:54.045775 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ec60-609f-48a1-9026-a20dd0886004 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:54.048277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 129/252] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:54.049145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3ec60-609f-48a1-9026-a20dd0886004 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:54.086585 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 124/253] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:54.088267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589531-0239-406f-bbae-b4a7c761490a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:54.088765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589531-0239-406f-bbae-b4a7c761490a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:54.089234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589531-0239-406f-bbae-b4a7c761490a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:54.106967 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-85589531-0239-406f-bbae-b4a7c761490a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:54.108551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-85589531-0239-406f-bbae-b4a7c761490a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:54.173903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3ec60-609f-48a1-9026-a20dd0886004 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:54.189582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 125/254] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:54.190879 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589531-0239-406f-bbae-b4a7c761490a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:54.209111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53b682-4d58-4691-b1a7-767091870346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:54.210296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53b682-4d58-4691-b1a7-767091870346 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:54.210429 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53b682-4d58-4691-b1a7-767091870346 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:54.210665 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53b682-4d58-4691-b1a7-767091870346 None admin] PATH_INFO: `/v3/users/e40e033892bd4f57abad3df12e6822a5` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:54.214735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53b682-4d58-4691-b1a7-767091870346 None admin] RBAC: Authorizing `identity:get_user(user_id=e40e033892bd4f57abad3df12e6822a5)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:54.214735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53b682-4d58-4691-b1a7-767091870346 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:54.215788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 130/255] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:54 2022] GET /identity/v3/users/e40e033892bd4f57abad3df12e6822a5 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:54.221093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53b682-4d58-4691-b1a7-767091870346 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:54.303230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589531-0239-406f-bbae-b4a7c761490a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:54.344086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80d75-5b84-4281-9095-0a58c9f8e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:54.345225 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80d75-5b84-4281-9095-0a58c9f8e2c9 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:54.346373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80d75-5b84-4281-9095-0a58c9f8e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:54.347352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80d75-5b84-4281-9095-0a58c9f8e2c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:54.351858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53b682-4d58-4691-b1a7-767091870346 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:54.360600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb80d75-5b84-4281-9095-0a58c9f8e2c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:54.370017 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-3cb80d75-5b84-4281-9095-0a58c9f8e2c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:38:54.372028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 126/256] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:38:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:54.373086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80d75-5b84-4281-9095-0a58c9f8e2c9 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:54.390967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea65797-4f15-4dc0-b016-6a5c0f9ddd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:54.392324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea65797-4f15-4dc0-b016-6a5c0f9ddd7b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:54.392691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea65797-4f15-4dc0-b016-6a5c0f9ddd7b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:54.393074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea65797-4f15-4dc0-b016-6a5c0f9ddd7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:54.467999 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea65797-4f15-4dc0-b016-6a5c0f9ddd7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:54.473380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea65797-4f15-4dc0-b016-6a5c0f9ddd7b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:54.572251 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80d75-5b84-4281-9095-0a58c9f8e2c9 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:54.592488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 131/257] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:54.593878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea65797-4f15-4dc0-b016-6a5c0f9ddd7b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:54.631743 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b16c3-2ea4-46b6-bbfc-a8d20311c78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:54.632566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b16c3-2ea4-46b6-bbfc-a8d20311c78a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:54.632841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b16c3-2ea4-46b6-bbfc-a8d20311c78a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:54.633112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b16c3-2ea4-46b6-bbfc-a8d20311c78a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:54.655356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b16c3-2ea4-46b6-bbfc-a8d20311c78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:54.662116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-9c5b16c3-2ea4-46b6-bbfc-a8d20311c78a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:38:54.662116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 127/258] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:54.662802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b16c3-2ea4-46b6-bbfc-a8d20311c78a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:54.763283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea65797-4f15-4dc0-b016-6a5c0f9ddd7b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:54.829903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7136-bec3-4e8a-aa1e-a4018b54c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:54.830905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7136-bec3-4e8a-aa1e-a4018b54c19e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:54.831371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7136-bec3-4e8a-aa1e-a4018b54c19e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:54.831786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7136-bec3-4e8a-aa1e-a4018b54c19e None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:54.832716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7136-bec3-4e8a-aa1e-a4018b54c19e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:54.833193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7136-bec3-4e8a-aa1e-a4018b54c19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:54.834919 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7136-bec3-4e8a-aa1e-a4018b54c19e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:54.852900 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 132/259] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:38:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:54.854018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7136-bec3-4e8a-aa1e-a4018b54c19e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:54.926214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b16c3-2ea4-46b6-bbfc-a8d20311c78a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:54.975348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd3801-cdba-4f9c-b84b-b63e03fb72b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:54.976244 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3801-cdba-4f9c-b84b-b63e03fb72b4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:54.976525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3801-cdba-4f9c-b84b-b63e03fb72b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:54.976797 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3801-cdba-4f9c-b84b-b63e03fb72b4 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:54.978974 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd3801-cdba-4f9c-b84b-b63e03fb72b4 None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:54.980444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd3801-cdba-4f9c-b84b-b63e03fb72b4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:54.982483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 128/260] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:54 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:54.983268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd3801-cdba-4f9c-b84b-b63e03fb72b4 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:55.050331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7136-bec3-4e8a-aa1e-a4018b54c19e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:55.093160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b7ff7-1da5-438e-aca9-030ebd8cd7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:55.093850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b7ff7-1da5-438e-aca9-030ebd8cd7f7 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:55.094156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b7ff7-1da5-438e-aca9-030ebd8cd7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:55.094468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b7ff7-1da5-438e-aca9-030ebd8cd7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:55.095219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b7ff7-1da5-438e-aca9-030ebd8cd7f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:55.095523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b7ff7-1da5-438e-aca9-030ebd8cd7f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:55.100612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b7ff7-1da5-438e-aca9-030ebd8cd7f7 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:55.115896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 133/261] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:55.120294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b7ff7-1da5-438e-aca9-030ebd8cd7f7 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:55.138946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd3801-cdba-4f9c-b84b-b63e03fb72b4 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:55.184417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc9cc2-64cc-496c-a5b3-dc557786334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:55.185319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc9cc2-64cc-496c-a5b3-dc557786334d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:55.185602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc9cc2-64cc-496c-a5b3-dc557786334d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:55.185876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc9cc2-64cc-496c-a5b3-dc557786334d None admin] PATH_INFO: `/v3/users/e40e033892bd4f57abad3df12e6822a5` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:55.189047 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc9cc2-64cc-496c-a5b3-dc557786334d None admin] RBAC: Authorizing `identity:get_user(user_id=e40e033892bd4f57abad3df12e6822a5)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:55.190547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc9cc2-64cc-496c-a5b3-dc557786334d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:55.192191 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 129/262] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:54 2022] GET /identity/v3/users/e40e033892bd4f57abad3df12e6822a5 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:55.192953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc9cc2-64cc-496c-a5b3-dc557786334d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:55.289714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b7ff7-1da5-438e-aca9-030ebd8cd7f7 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:55.338756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc9cc2-64cc-496c-a5b3-dc557786334d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:55.354261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4b31f-8eab-4357-b033-fda2c0e49d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:55.354952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4b31f-8eab-4357-b033-fda2c0e49d65 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:55.355229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4b31f-8eab-4357-b033-fda2c0e49d65 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:55.355498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4b31f-8eab-4357-b033-fda2c0e49d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:55.356347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4b31f-8eab-4357-b033-fda2c0e49d65 None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=13447c6176fd4fe4bc3cd6079394899c, user.id=e40e033892bd4f57abad3df12e6822a5) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:55.356667 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4b31f-8eab-4357-b033-fda2c0e49d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:55.358197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4b31f-8eab-4357-b033-fda2c0e49d65 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:55.376461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 134/263] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:55 2022] GET /identity/v3/role_assignments?user.id=e40e033892bd4f57abad3df12e6822a5&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:55.377329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4b31f-8eab-4357-b033-fda2c0e49d65 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:55.383536 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06601301-fb96-43e6-9192-4ccf6e33b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:55.384459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601301-fb96-43e6-9192-4ccf6e33b687 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:55.384998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601301-fb96-43e6-9192-4ccf6e33b687 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:55.385273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601301-fb96-43e6-9192-4ccf6e33b687 None admin] PATH_INFO: `/v3/users/e3fe18d8fcab438a8b415ab98f1eca46` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:55.387553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06601301-fb96-43e6-9192-4ccf6e33b687 None admin] RBAC: Authorizing `identity:get_user(user_id=e3fe18d8fcab438a8b415ab98f1eca46)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:55.389052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06601301-fb96-43e6-9192-4ccf6e33b687 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:55.390814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 130/264] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:55 2022] GET /identity/v3/users/e3fe18d8fcab438a8b415ab98f1eca46 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:55.397541 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06601301-fb96-43e6-9192-4ccf6e33b687 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:55.518673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06601301-fb96-43e6-9192-4ccf6e33b687 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:55.558756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76802467-beaa-4011-b106-ae72edd3182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:55.559646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76802467-beaa-4011-b106-ae72edd3182e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:55.559927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76802467-beaa-4011-b106-ae72edd3182e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:55.560199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76802467-beaa-4011-b106-ae72edd3182e None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:55.562037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76802467-beaa-4011-b106-ae72edd3182e None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:55.563632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76802467-beaa-4011-b106-ae72edd3182e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:55.565719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 131/265] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:55 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:55.571975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76802467-beaa-4011-b106-ae72edd3182e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:55.626173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4b31f-8eab-4357-b033-fda2c0e49d65 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:55.682896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76802467-beaa-4011-b106-ae72edd3182e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:55.712146 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a709e-57e0-447f-8731-d8c9e5236194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:55.712823 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a709e-57e0-447f-8731-d8c9e5236194 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:55.713177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a709e-57e0-447f-8731-d8c9e5236194 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:55.713452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a709e-57e0-447f-8731-d8c9e5236194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:55.721510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da423da-7fe2-4495-8640-fbe6bba1caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:55.722555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da423da-7fe2-4495-8640-fbe6bba1caa4 None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:55.722846 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da423da-7fe2-4495-8640-fbe6bba1caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:55.723115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da423da-7fe2-4495-8640-fbe6bba1caa4 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c/users/e3fe18d8fcab438a8b415ab98f1eca46/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:55.726911 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da423da-7fe2-4495-8640-fbe6bba1caa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=13447c6176fd4fe4bc3cd6079394899c, user_id=e3fe18d8fcab438a8b415ab98f1eca46, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:55.729350 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da423da-7fe2-4495-8640-fbe6bba1caa4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:55.758547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 132/266] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:38:55 2022] PUT /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c/users/e3fe18d8fcab438a8b415ab98f1eca46/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:38:55.819951 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a709e-57e0-447f-8731-d8c9e5236194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:55.821503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a709e-57e0-447f-8731-d8c9e5236194 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:55.928772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 135/267] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:55.934290 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da423da-7fe2-4495-8640-fbe6bba1caa4 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:56.055797 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da423da-7fe2-4495-8640-fbe6bba1caa4 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:56.104557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f5d3e-cf85-41a5-9e87-fa1022f38891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:56.105453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f5d3e-cf85-41a5-9e87-fa1022f38891 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:56.105730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f5d3e-cf85-41a5-9e87-fa1022f38891 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:56.106001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f5d3e-cf85-41a5-9e87-fa1022f38891 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:56.111022 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f5d3e-cf85-41a5-9e87-fa1022f38891 None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:56.112531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f5d3e-cf85-41a5-9e87-fa1022f38891 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:56.114729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 133/268] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:55 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:56.122179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a709e-57e0-447f-8731-d8c9e5236194 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:56.245018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a709e-57e0-447f-8731-d8c9e5236194 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:56.278958 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636700e-41af-4680-82a7-feb7343d8e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:56.279967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636700e-41af-4680-82a7-feb7343d8e63 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:56.280630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636700e-41af-4680-82a7-feb7343d8e63 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:56.281169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636700e-41af-4680-82a7-feb7343d8e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:56.282289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636700e-41af-4680-82a7-feb7343d8e63 None admin] RBAC: Adding query filter params (role.id=23f476d154c04684802479843819b199, scope.project.id=13447c6176fd4fe4bc3cd6079394899c, user.id=e40e033892bd4f57abad3df12e6822a5) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:56.282789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636700e-41af-4680-82a7-feb7343d8e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:56.284447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636700e-41af-4680-82a7-feb7343d8e63 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:56.291211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 136/269] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:38:56 2022] GET /identity/v3/role_assignments?user.id=e40e033892bd4f57abad3df12e6822a5&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=23f476d154c04684802479843819b199 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:56.510062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32430eb5-521e-48c0-8c5d-ba13806c8e96 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:56.510424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32430eb5-521e-48c0-8c5d-ba13806c8e96 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:56.510586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32430eb5-521e-48c0-8c5d-ba13806c8e96 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:56.512640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 134/270] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:56.518064 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f213909-ac59-43f1-b598-7d9488e4cd29 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:56.518391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f213909-ac59-43f1-b598-7d9488e4cd29 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:56.518672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f213909-ac59-43f1-b598-7d9488e4cd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:56.536359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-9f213909-ac59-43f1-b598-7d9488e4cd29 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:56.537596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9f213909-ac59-43f1-b598-7d9488e4cd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:56.608246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 137/271] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:56.631868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32430eb5-521e-48c0-8c5d-ba13806c8e96 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:56.746330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32430eb5-521e-48c0-8c5d-ba13806c8e96 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:56.780599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50def449-7629-45da-8666-d3626cb9585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:56.781331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50def449-7629-45da-8666-d3626cb9585f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:56.781615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50def449-7629-45da-8666-d3626cb9585f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:56.781890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50def449-7629-45da-8666-d3626cb9585f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:56.792595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50def449-7629-45da-8666-d3626cb9585f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:56.800339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-50def449-7629-45da-8666-d3626cb9585f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:38:56.801918 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 135/272] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:56.807861 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f213909-ac59-43f1-b598-7d9488e4cd29 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:56.901099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b639e-e4e0-4c05-a90f-8e45c4c5fd10 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:56.901447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b639e-e4e0-4c05-a90f-8e45c4c5fd10 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:56.901660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b639e-e4e0-4c05-a90f-8e45c4c5fd10 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:56.903615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 136/273] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:38:56.909609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a87bb-4627-411e-9313-d499d694dbc5 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:56.910018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a87bb-4627-411e-9313-d499d694dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:56.910455 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a87bb-4627-411e-9313-d499d694dbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:56.918818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f213909-ac59-43f1-b598-7d9488e4cd29 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:56.934448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b56a87bb-4627-411e-9313-d499d694dbc5 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:56.935655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b56a87bb-4627-411e-9313-d499d694dbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:56.960641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dc10b-bb11-4dfd-b440-528c835dec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:56.961341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dc10b-bb11-4dfd-b440-528c835dec12 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:56.961625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dc10b-bb11-4dfd-b440-528c835dec12 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:56.961895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dc10b-bb11-4dfd-b440-528c835dec12 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:56.962697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dc10b-bb11-4dfd-b440-528c835dec12 None admin] RBAC: Adding query filter params (name=member) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:56.962998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dc10b-bb11-4dfd-b440-528c835dec12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:56.964487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dc10b-bb11-4dfd-b440-528c835dec12 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:56.973758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 138/274] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:56.980500 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dc10b-bb11-4dfd-b440-528c835dec12 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:57.030051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 137/275] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:38:57.031562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f8a3-c6e1-4886-8d93-6898f841ef3d None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.031794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f8a3-c6e1-4886-8d93-6898f841ef3d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.032136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f8a3-c6e1-4886-8d93-6898f841ef3d None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.033962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 138/276] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:57.039152 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d42dd-e8e8-4ce1-8dd2-107da7f56c91 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.039433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d42dd-e8e8-4ce1-8dd2-107da7f56c91 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.039706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d42dd-e8e8-4ce1-8dd2-107da7f56c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.056600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ba9d42dd-e8e8-4ce1-8dd2-107da7f56c91 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:57.057781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ba9d42dd-e8e8-4ce1-8dd2-107da7f56c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:57.090724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dc10b-bb11-4dfd-b440-528c835dec12 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:57.122781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 139/277] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:38:57.123485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d42dd-e8e8-4ce1-8dd2-107da7f56c91 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:57.134437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25f93c-f79f-4eb3-9323-64f6320a68a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:57.137028 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25f93c-f79f-4eb3-9323-64f6320a68a8 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.137320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25f93c-f79f-4eb3-9323-64f6320a68a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.137608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25f93c-f79f-4eb3-9323-64f6320a68a8 None admin] PATH_INFO: `/v3/users/850f364cf2ae41e8811a6ee8fb08bc13` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.154425 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25f93c-f79f-4eb3-9323-64f6320a68a8 None admin] RBAC: Authorizing `identity:get_user(user_id=850f364cf2ae41e8811a6ee8fb08bc13)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:57.155925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25f93c-f79f-4eb3-9323-64f6320a68a8 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:57.162523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 139/278] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:56 2022] GET /identity/v3/users/850f364cf2ae41e8811a6ee8fb08bc13 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:57.163221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25f93c-f79f-4eb3-9323-64f6320a68a8 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:57.233538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d42dd-e8e8-4ce1-8dd2-107da7f56c91 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:57.265602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0fdc0-c166-4c17-8787-f563745602cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:57.265797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25f93c-f79f-4eb3-9323-64f6320a68a8 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:57.266497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0fdc0-c166-4c17-8787-f563745602cf None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.266752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0fdc0-c166-4c17-8787-f563745602cf None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.267024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0fdc0-c166-4c17-8787-f563745602cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.278447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0fdc0-c166-4c17-8787-f563745602cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:57.285571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-f1f0fdc0-c166-4c17-8787-f563745602cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:38:57.286741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 140/279] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:57.290219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0fdc0-c166-4c17-8787-f563745602cf None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:57.302521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720b83-382d-4c06-81e9-778d2fe9e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:57.303560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720b83-382d-4c06-81e9-778d2fe9e5e3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.304010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720b83-382d-4c06-81e9-778d2fe9e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.304591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720b83-382d-4c06-81e9-778d2fe9e5e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.305890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa720b83-382d-4c06-81e9-778d2fe9e5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:57.307435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa720b83-382d-4c06-81e9-778d2fe9e5e3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:57.309180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 140/280] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:38:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:57.314359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720b83-382d-4c06-81e9-778d2fe9e5e3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:57.389688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0fdc0-c166-4c17-8787-f563745602cf None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:57.414413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720b83-382d-4c06-81e9-778d2fe9e5e3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:57.432399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea840b4-f25a-4c63-8590-4ce186c4c81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:57.433068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea840b4-f25a-4c63-8590-4ce186c4c81e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.433348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea840b4-f25a-4c63-8590-4ce186c4c81e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.433621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea840b4-f25a-4c63-8590-4ce186c4c81e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.434910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea840b4-f25a-4c63-8590-4ce186c4c81e None admin] RBAC: Adding query filter params (role.id=20d2df2c0f34477d842f0e792557bb47, user.id=850f364cf2ae41e8811a6ee8fb08bc13, scope.system=all) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:57.435224 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea840b4-f25a-4c63-8590-4ce186c4c81e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:57.437160 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea840b4-f25a-4c63-8590-4ce186c4c81e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:57.454472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 141/281] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Oct 28 19:38:57 2022] GET /identity/v3/role_assignments?user.id=850f364cf2ae41e8811a6ee8fb08bc13&scope.system=all&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:57.454472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea840b4-f25a-4c63-8590-4ce186c4c81e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:57.457352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6368a-870e-4de8-a6d0-035a1ac844b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:57.458053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6368a-870e-4de8-a6d0-035a1ac844b2 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.458362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6368a-870e-4de8-a6d0-035a1ac844b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.458634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6368a-870e-4de8-a6d0-035a1ac844b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.459400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6368a-870e-4de8-a6d0-035a1ac844b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:57.459710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6368a-870e-4de8-a6d0-035a1ac844b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:57.461152 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6368a-870e-4de8-a6d0-035a1ac844b2 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:57.470892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 141/282] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:57.476846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6368a-870e-4de8-a6d0-035a1ac844b2 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:57.588201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea840b4-f25a-4c63-8590-4ce186c4c81e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:57.588389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6368a-870e-4de8-a6d0-035a1ac844b2 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:57.623296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf3f03-94de-4a01-a08d-6afd1342944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:57.624062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf3f03-94de-4a01-a08d-6afd1342944f None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.624365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf3f03-94de-4a01-a08d-6afd1342944f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.624634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf3f03-94de-4a01-a08d-6afd1342944f None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.625362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf3f03-94de-4a01-a08d-6afd1342944f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:57.627102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf3f03-94de-4a01-a08d-6afd1342944f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:57.631890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f238375-d44f-4045-91d8-8d63a54ba45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:57.633075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f238375-d44f-4045-91d8-8d63a54ba45f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.633536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f238375-d44f-4045-91d8-8d63a54ba45f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.634215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f238375-d44f-4045-91d8-8d63a54ba45f None admin] PATH_INFO: `/v3/users/86ad662f809a4cdbbc645bcff0e22e3e` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.635630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f238375-d44f-4045-91d8-8d63a54ba45f None admin] RBAC: Authorizing `identity:get_user(user_id=86ad662f809a4cdbbc645bcff0e22e3e)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:57.637284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f238375-d44f-4045-91d8-8d63a54ba45f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:57.644235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 142/283] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:57 2022] GET /identity/v3/users/86ad662f809a4cdbbc645bcff0e22e3e => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:57.648711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f238375-d44f-4045-91d8-8d63a54ba45f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:57.655147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 142/284] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:38:57 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:38:57.769206 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f238375-d44f-4045-91d8-8d63a54ba45f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:57.804927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564cd06-906d-44ad-8d80-4a93e6b3d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:57.805880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564cd06-906d-44ad-8d80-4a93e6b3d3bf None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.806193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564cd06-906d-44ad-8d80-4a93e6b3d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.806466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564cd06-906d-44ad-8d80-4a93e6b3d3bf None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.807747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564cd06-906d-44ad-8d80-4a93e6b3d3bf None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:57.809228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564cd06-906d-44ad-8d80-4a93e6b3d3bf None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:57.811366 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 143/285] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:57 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:38:57.817501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf3f03-94de-4a01-a08d-6afd1342944f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:57.918911 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf3f03-94de-4a01-a08d-6afd1342944f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:57.952843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49381b-3cc1-46e2-b62c-887828643ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:57.954597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49381b-3cc1-46e2-b62c-887828643ffe None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:57.955057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49381b-3cc1-46e2-b62c-887828643ffe None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:57.955327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49381b-3cc1-46e2-b62c-887828643ffe None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c/users/86ad662f809a4cdbbc645bcff0e22e3e/roles/43312a4c8be340a889e15774cd34870a` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:57.957317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49381b-3cc1-46e2-b62c-887828643ffe None admin] RBAC: Authorizing `identity:create_grant(project_id=13447c6176fd4fe4bc3cd6079394899c, user_id=86ad662f809a4cdbbc645bcff0e22e3e, role_id=43312a4c8be340a889e15774cd34870a)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:57.958852 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49381b-3cc1-46e2-b62c-887828643ffe None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:57.977589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 143/286] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:38:57 2022] PUT /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c/users/86ad662f809a4cdbbc645bcff0e22e3e/roles/43312a4c8be340a889e15774cd34870a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:38:58.695813 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea312e6-c75b-4a5b-b60c-e25cd5ef418f None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:58.696369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea312e6-c75b-4a5b-b60c-e25cd5ef418f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:58.696369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea312e6-c75b-4a5b-b60c-e25cd5ef418f None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:58.698403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 144/287] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:38:58.703515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ed97b-9f5d-480b-9a30-9065072df753 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:58.703807 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ed97b-9f5d-480b-9a30-9065072df753 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:58.704118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ed97b-9f5d-480b-9a30-9065072df753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:58.726219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b56ed97b-9f5d-480b-9a30-9065072df753 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:38:58.727390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b56ed97b-9f5d-480b-9a30-9065072df753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:38:58.811558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 144/288] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:38:58.857520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea312e6-c75b-4a5b-b60c-e25cd5ef418f None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:58.979818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea312e6-c75b-4a5b-b60c-e25cd5ef418f None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:59.021562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cfeba-1f3a-40fb-8e0f-1d4356d84d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:59.022431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cfeba-1f3a-40fb-8e0f-1d4356d84d43 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:59.022709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cfeba-1f3a-40fb-8e0f-1d4356d84d43 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:59.022979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cfeba-1f3a-40fb-8e0f-1d4356d84d43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:59.037023 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cfeba-1f3a-40fb-8e0f-1d4356d84d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:38:59.044235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c22cfeba-1f3a-40fb-8e0f-1d4356d84d43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:38:59.045438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 145/289] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:38:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:38:59.051913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ed97b-9f5d-480b-9a30-9065072df753 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:59.156757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ed97b-9f5d-480b-9a30-9065072df753 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:59.197490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e9ea7-9e3b-4cd4-8db2-4b19b57de8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:59.198194 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e9ea7-9e3b-4cd4-8db2-4b19b57de8a1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:59.198476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e9ea7-9e3b-4cd4-8db2-4b19b57de8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:59.198745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e9ea7-9e3b-4cd4-8db2-4b19b57de8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:59.199494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e9ea7-9e3b-4cd4-8db2-4b19b57de8a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:38:59.199793 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e9ea7-9e3b-4cd4-8db2-4b19b57de8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:59.201176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e9ea7-9e3b-4cd4-8db2-4b19b57de8a1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:59.210175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 145/290] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:38:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:59.215638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cfeba-1f3a-40fb-8e0f-1d4356d84d43 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:59.389667 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cfeba-1f3a-40fb-8e0f-1d4356d84d43 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:59.562986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18ffb6-6a4f-4213-a5c2-7314a074bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:59.564025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18ffb6-6a4f-4213-a5c2-7314a074bc9e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:59.564307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18ffb6-6a4f-4213-a5c2-7314a074bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:59.564583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18ffb6-6a4f-4213-a5c2-7314a074bc9e None admin] PATH_INFO: `/v3/users/e3fe18d8fcab438a8b415ab98f1eca46` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:59.565787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18ffb6-6a4f-4213-a5c2-7314a074bc9e None admin] RBAC: Authorizing `identity:get_user(user_id=e3fe18d8fcab438a8b415ab98f1eca46)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:59.567284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18ffb6-6a4f-4213-a5c2-7314a074bc9e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:59.569239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 146/291] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:38:59 2022] GET /identity/v3/users/e3fe18d8fcab438a8b415ab98f1eca46 => generated 297 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:38:59.574643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e9ea7-9e3b-4cd4-8db2-4b19b57de8a1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:38:59.736680 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e9ea7-9e3b-4cd4-8db2-4b19b57de8a1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:38:59.785146 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45ac54-929b-44c5-ad8e-39ef7b6a6fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:38:59.786258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ac54-929b-44c5-ad8e-39ef7b6a6fd6 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:38:59.786761 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ac54-929b-44c5-ad8e-39ef7b6a6fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:38:59.787270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ac54-929b-44c5-ad8e-39ef7b6a6fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:38:59.869273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45ac54-929b-44c5-ad8e-39ef7b6a6fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:38:59.870883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45ac54-929b-44c5-ad8e-39ef7b6a6fd6 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:38:59.985255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 146/292] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:59.991288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18ffb6-6a4f-4213-a5c2-7314a074bc9e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:00.092217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18ffb6-6a4f-4213-a5c2-7314a074bc9e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:00.126601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e03b7-3e91-426d-b90e-c9a5ff0a0d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:00.127830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e03b7-3e91-426d-b90e-c9a5ff0a0d03 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.128329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e03b7-3e91-426d-b90e-c9a5ff0a0d03 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.128805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e03b7-3e91-426d-b90e-c9a5ff0a0d03 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.130223 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e03b7-3e91-426d-b90e-c9a5ff0a0d03 None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:00.132037 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e03b7-3e91-426d-b90e-c9a5ff0a0d03 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:00.138303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 147/293] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:38:59 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:00.140453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45ac54-929b-44c5-ad8e-39ef7b6a6fd6 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:00.244227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45ac54-929b-44c5-ad8e-39ef7b6a6fd6 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:00.277765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff55d9-decc-4dd7-ba45-4d39cce959a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:00.278803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff55d9-decc-4dd7-ba45-4d39cce959a4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.279279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff55d9-decc-4dd7-ba45-4d39cce959a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.279742 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff55d9-decc-4dd7-ba45-4d39cce959a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.280799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff55d9-decc-4dd7-ba45-4d39cce959a4 None admin] RBAC: Adding query filter params (role.id=20d2df2c0f34477d842f0e792557bb47, scope.project.id=13447c6176fd4fe4bc3cd6079394899c, user.id=e3fe18d8fcab438a8b415ab98f1eca46) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:00.281316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff55d9-decc-4dd7-ba45-4d39cce959a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:00.283126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff55d9-decc-4dd7-ba45-4d39cce959a4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:00.289493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 147/294] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:00 2022] GET /identity/v3/role_assignments?user.id=e3fe18d8fcab438a8b415ab98f1eca46&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:00.412256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b23fd-e9b5-4024-bd09-279d6aa51881 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.412920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b23fd-e9b5-4024-bd09-279d6aa51881 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.413674 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b23fd-e9b5-4024-bd09-279d6aa51881 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.415759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 148/295] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:00.421762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0512d-0b45-4db5-b989-cfaa1bd17d95 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.422365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0512d-0b45-4db5-b989-cfaa1bd17d95 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.423278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0512d-0b45-4db5-b989-cfaa1bd17d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.447214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-76b0512d-0b45-4db5-b989-cfaa1bd17d95 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:00.448742 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-76b0512d-0b45-4db5-b989-cfaa1bd17d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:00.536605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 148/296] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:00.550760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad097cd9-f70a-4b34-8bf0-da6649d1a302 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.551465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad097cd9-f70a-4b34-8bf0-da6649d1a302 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.551955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad097cd9-f70a-4b34-8bf0-da6649d1a302 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.554018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 149/297] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:00.559746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889a5a4-bfba-4f2b-ad50-183b1ceccfc0 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.560311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889a5a4-bfba-4f2b-ad50-183b1ceccfc0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.560802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889a5a4-bfba-4f2b-ad50-183b1ceccfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.563461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad097cd9-f70a-4b34-8bf0-da6649d1a302 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:00.589795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-9889a5a4-bfba-4f2b-ad50-183b1ceccfc0 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:00.591021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9889a5a4-bfba-4f2b-ad50-183b1ceccfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:00.665023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 149/298] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:00.689563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889a5a4-bfba-4f2b-ad50-183b1ceccfc0 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:00.695670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad097cd9-f70a-4b34-8bf0-da6649d1a302 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:00.742498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefe91c-8428-484e-af0b-06db51af7caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:00.743940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefe91c-8428-484e-af0b-06db51af7caf None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.744404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefe91c-8428-484e-af0b-06db51af7caf None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.744983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefe91c-8428-484e-af0b-06db51af7caf None admin] PATH_INFO: `/v3/roles/member` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.760530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefe91c-8428-484e-af0b-06db51af7caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:00.770506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-adefe91c-8428-484e-af0b-06db51af7caf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:39:00.772336 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 150/299] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:00.783147 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefe91c-8428-484e-af0b-06db51af7caf None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:00.810218 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889a5a4-bfba-4f2b-ad50-183b1ceccfc0 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:00.849804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ead05-e55a-4369-bedd-a2d816909bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:00.850644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ead05-e55a-4369-bedd-a2d816909bce None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.850925 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ead05-e55a-4369-bedd-a2d816909bce None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.851183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ead05-e55a-4369-bedd-a2d816909bce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.860827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ead05-e55a-4369-bedd-a2d816909bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:00.867880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a29ead05-e55a-4369-bedd-a2d816909bce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:39:00.869309 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 150/300] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:00.870697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def8db7-173a-487a-9337-ab36ffe4eaaa None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.870974 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def8db7-173a-487a-9337-ab36ffe4eaaa None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.871241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def8db7-173a-487a-9337-ab36ffe4eaaa None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.872889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 151/301] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:00.874946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def8db7-173a-487a-9337-ab36ffe4eaaa None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:00.895274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefe91c-8428-484e-af0b-06db51af7caf None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:00.929845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987e751-eebf-4d92-b2e2-da434c19e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:00.930556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987e751-eebf-4d92-b2e2-da434c19e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.930833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987e751-eebf-4d92-b2e2-da434c19e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.931516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987e751-eebf-4d92-b2e2-da434c19e5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.932421 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987e751-eebf-4d92-b2e2-da434c19e5e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:00.932837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987e751-eebf-4d92-b2e2-da434c19e5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:00.934709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987e751-eebf-4d92-b2e2-da434c19e5e0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:00.945186 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 151/302] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:00.946399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e4a3c-d73f-4b43-8daf-5d3268891de1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:00.946678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e4a3c-d73f-4b43-8daf-5d3268891de1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:00.946944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e4a3c-d73f-4b43-8daf-5d3268891de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:00.966402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-671e4a3c-d73f-4b43-8daf-5d3268891de1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:00.967864 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-671e4a3c-d73f-4b43-8daf-5d3268891de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:00.981953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def8db7-173a-487a-9337-ab36ffe4eaaa None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:01.015337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4aed2-558c-4a07-b0e1-00d0c3807df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:01.016013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4aed2-558c-4a07-b0e1-00d0c3807df5 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.016293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4aed2-558c-4a07-b0e1-00d0c3807df5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.016564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4aed2-558c-4a07-b0e1-00d0c3807df5 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.017378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4aed2-558c-4a07-b0e1-00d0c3807df5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:01.017654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4aed2-558c-4a07-b0e1-00d0c3807df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:01.019071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4aed2-558c-4a07-b0e1-00d0c3807df5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:01.027427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 152/303] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:01.028078 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4aed2-558c-4a07-b0e1-00d0c3807df5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:01.050102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 152/304] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:01.050102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e4a3c-d73f-4b43-8daf-5d3268891de1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:01.134532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4aed2-558c-4a07-b0e1-00d0c3807df5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:01.138265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e4a3c-d73f-4b43-8daf-5d3268891de1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:01.165237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983331c-f961-4e2f-a2ab-0a9b3c36930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:01.166139 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983331c-f961-4e2f-a2ab-0a9b3c36930d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.166417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983331c-f961-4e2f-a2ab-0a9b3c36930d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.166833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983331c-f961-4e2f-a2ab-0a9b3c36930d None admin] PATH_INFO: `/v3/users/850f364cf2ae41e8811a6ee8fb08bc13` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.168001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983331c-f961-4e2f-a2ab-0a9b3c36930d None admin] RBAC: Authorizing `identity:get_user(user_id=850f364cf2ae41e8811a6ee8fb08bc13)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:01.169427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983331c-f961-4e2f-a2ab-0a9b3c36930d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:01.170401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4e2f9-ce94-40a5-b03a-a780ae2fdc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:01.171233 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 153/305] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:39:01 2022] GET /identity/v3/users/850f364cf2ae41e8811a6ee8fb08bc13 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:01.171349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4e2f9-ce94-40a5-b03a-a780ae2fdc54 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.171549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4e2f9-ce94-40a5-b03a-a780ae2fdc54 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.171821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4e2f9-ce94-40a5-b03a-a780ae2fdc54 None admin] PATH_INFO: `/v3/users/7dd8038171094437bca407baf3df0ef0` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.171919 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983331c-f961-4e2f-a2ab-0a9b3c36930d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:01.185824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4e2f9-ce94-40a5-b03a-a780ae2fdc54 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd8038171094437bca407baf3df0ef0)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:01.187323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4e2f9-ce94-40a5-b03a-a780ae2fdc54 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:01.189230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 153/306] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:39:01 2022] GET /identity/v3/users/7dd8038171094437bca407baf3df0ef0 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:01.190309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ede0-38e3-43c3-834b-3d01c2695d39 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.190591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ede0-38e3-43c3-834b-3d01c2695d39 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.190869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ede0-38e3-43c3-834b-3d01c2695d39 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.192474 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 154/307] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:01.193330 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ede0-38e3-43c3-834b-3d01c2695d39 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:01.267035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983331c-f961-4e2f-a2ab-0a9b3c36930d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:01.290622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ede0-38e3-43c3-834b-3d01c2695d39 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:01.299952 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aafe88-8835-420f-9dc1-912533a32720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:01.300758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aafe88-8835-420f-9dc1-912533a32720 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.301035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aafe88-8835-420f-9dc1-912533a32720 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.301302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aafe88-8835-420f-9dc1-912533a32720 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.302563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aafe88-8835-420f-9dc1-912533a32720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:01.304000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aafe88-8835-420f-9dc1-912533a32720 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:01.305590 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 154/308] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:01.306372 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aafe88-8835-420f-9dc1-912533a32720 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:01.322652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53ae59-52b5-4f2b-8637-8176abfae490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:01.323525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53ae59-52b5-4f2b-8637-8176abfae490 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.323808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53ae59-52b5-4f2b-8637-8176abfae490 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.324083 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53ae59-52b5-4f2b-8637-8176abfae490 None admin] PATH_INFO: `/v3/system/users/850f364cf2ae41e8811a6ee8fb08bc13/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.325535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53ae59-52b5-4f2b-8637-8176abfae490 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=850f364cf2ae41e8811a6ee8fb08bc13, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:01.326954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53ae59-52b5-4f2b-8637-8176abfae490 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:01.337519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 155/309] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Oct 28 19:39:01 2022] PUT /identity/v3/system/users/850f364cf2ae41e8811a6ee8fb08bc13/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:39:01.338937 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a0fe5-371e-4a8a-9f77-e3e0b121616e None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.339225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a0fe5-371e-4a8a-9f77-e3e0b121616e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.339500 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a0fe5-371e-4a8a-9f77-e3e0b121616e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.358188 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f65a0fe5-371e-4a8a-9f77-e3e0b121616e None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:01.359412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f65a0fe5-371e-4a8a-9f77-e3e0b121616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:01.429465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 156/310] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:01.429672 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aafe88-8835-420f-9dc1-912533a32720 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:01.430810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a0fe5-371e-4a8a-9f77-e3e0b121616e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:01.480265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf67bab-9c69-4a38-9738-3c71df1fae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:01.480952 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf67bab-9c69-4a38-9738-3c71df1fae7d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.481233 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf67bab-9c69-4a38-9738-3c71df1fae7d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.481508 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf67bab-9c69-4a38-9738-3c71df1fae7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.482387 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf67bab-9c69-4a38-9738-3c71df1fae7d None admin] RBAC: Adding query filter params (role.id=43312a4c8be340a889e15774cd34870a, user.id=7dd8038171094437bca407baf3df0ef0, scope.system=all) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:01.482714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf67bab-9c69-4a38-9738-3c71df1fae7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:01.484192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf67bab-9c69-4a38-9738-3c71df1fae7d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:01.498121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 155/311] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Oct 28 19:39:01 2022] GET /identity/v3/role_assignments?user.id=7dd8038171094437bca407baf3df0ef0&scope.system=all&role.id=43312a4c8be340a889e15774cd34870a => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:01.498121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf67bab-9c69-4a38-9738-3c71df1fae7d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:01.558529 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a0fe5-371e-4a8a-9f77-e3e0b121616e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:01.612919 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf67bab-9c69-4a38-9738-3c71df1fae7d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:01.616128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81a2ea-5f16-41b7-a371-55800df417eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:01.616907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81a2ea-5f16-41b7-a371-55800df417eb None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.617197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81a2ea-5f16-41b7-a371-55800df417eb None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.617509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81a2ea-5f16-41b7-a371-55800df417eb None admin] PATH_INFO: `/v3/groups` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.618307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81a2ea-5f16-41b7-a371-55800df417eb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:01.619794 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81a2ea-5f16-41b7-a371-55800df417eb None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:01.640995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 157/312] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Oct 28 19:39:01 2022] POST /identity/v3/groups => generated 229 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:39:01.659776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd0c68-ea9d-4888-88fa-8bada1b378bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:01.661086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd0c68-ea9d-4888-88fa-8bada1b378bc None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.661574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd0c68-ea9d-4888-88fa-8bada1b378bc None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.662028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd0c68-ea9d-4888-88fa-8bada1b378bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.676184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd0c68-ea9d-4888-88fa-8bada1b378bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:01.684282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-68dd0c68-ea9d-4888-88fa-8bada1b378bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:39:01.686261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 156/313] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:01.695580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81a2ea-5f16-41b7-a371-55800df417eb None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:01.806674 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81a2ea-5f16-41b7-a371-55800df417eb None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:01.846519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b6390-24bf-45fa-b725-15ee4540a1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:01.847198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b6390-24bf-45fa-b725-15ee4540a1bc None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.847475 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b6390-24bf-45fa-b725-15ee4540a1bc None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.847743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b6390-24bf-45fa-b725-15ee4540a1bc None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.848499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b6390-24bf-45fa-b725-15ee4540a1bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:01.848800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b6390-24bf-45fa-b725-15ee4540a1bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:01.850202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b6390-24bf-45fa-b725-15ee4540a1bc None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:01.858902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 158/314] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:01.864464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd0c68-ea9d-4888-88fa-8bada1b378bc None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:01.964772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd0c68-ea9d-4888-88fa-8bada1b378bc None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:01.997119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f094a9-0095-4b6a-8d78-31d75e6bf771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:01.998008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f094a9-0095-4b6a-8d78-31d75e6bf771 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:01.998324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f094a9-0095-4b6a-8d78-31d75e6bf771 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:01.998593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f094a9-0095-4b6a-8d78-31d75e6bf771 None admin] PATH_INFO: `/v3/users/86ad662f809a4cdbbc645bcff0e22e3e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:01.999777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f094a9-0095-4b6a-8d78-31d75e6bf771 None admin] RBAC: Authorizing `identity:get_user(user_id=86ad662f809a4cdbbc645bcff0e22e3e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:02.001311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f094a9-0095-4b6a-8d78-31d75e6bf771 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:02.003228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 157/315] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:39:01 2022] GET /identity/v3/users/86ad662f809a4cdbbc645bcff0e22e3e => generated 297 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:02.008882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b6390-24bf-45fa-b725-15ee4540a1bc None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:02.111168 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b6390-24bf-45fa-b725-15ee4540a1bc None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:02.144949 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c02410-03ef-4ef6-997b-3f454f246cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:02.146016 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c02410-03ef-4ef6-997b-3f454f246cfd None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:02.146540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c02410-03ef-4ef6-997b-3f454f246cfd None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:02.147075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c02410-03ef-4ef6-997b-3f454f246cfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:02.213759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c02410-03ef-4ef6-997b-3f454f246cfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:02.215660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c02410-03ef-4ef6-997b-3f454f246cfd None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:02.318313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 159/316] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:02.320050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f094a9-0095-4b6a-8d78-31d75e6bf771 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:02.419940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f094a9-0095-4b6a-8d78-31d75e6bf771 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:02.453598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e765eb3-5d3f-4c64-a59b-974fc149e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:02.454543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e765eb3-5d3f-4c64-a59b-974fc149e977 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:02.454876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e765eb3-5d3f-4c64-a59b-974fc149e977 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:02.455149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e765eb3-5d3f-4c64-a59b-974fc149e977 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:02.456322 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e765eb3-5d3f-4c64-a59b-974fc149e977 None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:02.457750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e765eb3-5d3f-4c64-a59b-974fc149e977 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:02.459797 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 158/317] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:02 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:02.465800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c02410-03ef-4ef6-997b-3f454f246cfd None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:02.567531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c02410-03ef-4ef6-997b-3f454f246cfd None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:02.601384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7b7e7-abe0-4e70-a0c8-0f78011944a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:02.602502 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7b7e7-abe0-4e70-a0c8-0f78011944a4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:02.603028 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7b7e7-abe0-4e70-a0c8-0f78011944a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:02.603536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7b7e7-abe0-4e70-a0c8-0f78011944a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:02.604614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7b7e7-abe0-4e70-a0c8-0f78011944a4 None admin] RBAC: Adding query filter params (role.id=43312a4c8be340a889e15774cd34870a, scope.project.id=13447c6176fd4fe4bc3cd6079394899c, user.id=86ad662f809a4cdbbc645bcff0e22e3e) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:02.605140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7b7e7-abe0-4e70-a0c8-0f78011944a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:02.606877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7b7e7-abe0-4e70-a0c8-0f78011944a4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:02.618189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 160/318] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:02 2022] GET /identity/v3/role_assignments?user.id=86ad662f809a4cdbbc645bcff0e22e3e&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=43312a4c8be340a889e15774cd34870a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:03.701955 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e652-19d4-41a2-8a16-9ccd59dd0b45 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:03.702558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e652-19d4-41a2-8a16-9ccd59dd0b45 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:03.702558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e652-19d4-41a2-8a16-9ccd59dd0b45 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:03.704634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 159/319] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:03.710336 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb81eb-c2b2-4360-9114-05213916acb6 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:03.710876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb81eb-c2b2-4360-9114-05213916acb6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:03.710876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb81eb-c2b2-4360-9114-05213916acb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:03.728272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-91cb81eb-c2b2-4360-9114-05213916acb6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:03.729452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-91cb81eb-c2b2-4360-9114-05213916acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:03.797586 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 161/320] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:03.821383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79e652-19d4-41a2-8a16-9ccd59dd0b45 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:03.891505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f8476-138d-4635-9bcd-7b8b5fd841bb None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:03.891811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f8476-138d-4635-9bcd-7b8b5fd841bb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:03.892848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f8476-138d-4635-9bcd-7b8b5fd841bb None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:03.894049 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 162/321] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:03.899131 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c75201-54ab-454b-a1a2-187d4eb3bb5c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:03.899390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c75201-54ab-454b-a1a2-187d4eb3bb5c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:03.899665 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c75201-54ab-454b-a1a2-187d4eb3bb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:03.916189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-a1c75201-54ab-454b-a1a2-187d4eb3bb5c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:03.917363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-a1c75201-54ab-454b-a1a2-187d4eb3bb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:03.930848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79e652-19d4-41a2-8a16-9ccd59dd0b45 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:03.968107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113ef98-280b-4a64-a1e8-7373e9ae36ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:03.968917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113ef98-280b-4a64-a1e8-7373e9ae36ba None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:03.969195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113ef98-280b-4a64-a1e8-7373e9ae36ba None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:03.969469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113ef98-280b-4a64-a1e8-7373e9ae36ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:03.980206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113ef98-280b-4a64-a1e8-7373e9ae36ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:03.986550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 163/322] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:03.989779 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-6113ef98-280b-4a64-a1e8-7373e9ae36ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:39:03.991152 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 160/323] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:03.996800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c75201-54ab-454b-a1a2-187d4eb3bb5c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:04.010418 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113ef98-280b-4a64-a1e8-7373e9ae36ba None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:04.094496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c75201-54ab-454b-a1a2-187d4eb3bb5c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:04.108220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113ef98-280b-4a64-a1e8-7373e9ae36ba None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:04.128808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4edd-e9ed-4743-9ac6-4967edf0030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:04.129488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4edd-e9ed-4743-9ac6-4967edf0030d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.129760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4edd-e9ed-4743-9ac6-4967edf0030d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.130034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4edd-e9ed-4743-9ac6-4967edf0030d None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.130814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4edd-e9ed-4743-9ac6-4967edf0030d None admin] RBAC: Adding query filter params (name=member) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:04.131114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4edd-e9ed-4743-9ac6-4967edf0030d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:04.132511 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4edd-e9ed-4743-9ac6-4967edf0030d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:04.139756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7274b0-f28d-488e-b556-4b7de578c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:04.140517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 164/324] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:04.140642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7274b0-f28d-488e-b556-4b7de578c22d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.140821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7274b0-f28d-488e-b556-4b7de578c22d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.141109 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7274b0-f28d-488e-b556-4b7de578c22d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.143645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec4b00-d1de-4d94-8444-13e95581f8a2 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.144182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec4b00-d1de-4d94-8444-13e95581f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.144449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec4b00-d1de-4d94-8444-13e95581f8a2 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.146234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 165/325] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:04.147015 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec4b00-d1de-4d94-8444-13e95581f8a2 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:04.152224 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7274b0-f28d-488e-b556-4b7de578c22d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:04.159343 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-be7274b0-f28d-488e-b556-4b7de578c22d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:39:04.160556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 161/326] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:04.161718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22fa2b-0aa0-4b38-9bb0-fb8cf27ee59b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.162001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22fa2b-0aa0-4b38-9bb0-fb8cf27ee59b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.162288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22fa2b-0aa0-4b38-9bb0-fb8cf27ee59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.179227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-4c22fa2b-0aa0-4b38-9bb0-fb8cf27ee59b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:04.180403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4c22fa2b-0aa0-4b38-9bb0-fb8cf27ee59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:04.242654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec4b00-d1de-4d94-8444-13e95581f8a2 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:04.244827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 162/327] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:04.245439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22fa2b-0aa0-4b38-9bb0-fb8cf27ee59b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:04.275615 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402131cb-8e8c-466b-bbde-62cd057f64d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:04.276494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402131cb-8e8c-466b-bbde-62cd057f64d1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.276769 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402131cb-8e8c-466b-bbde-62cd057f64d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.277036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402131cb-8e8c-466b-bbde-62cd057f64d1 None admin] PATH_INFO: `/v3/users/850f364cf2ae41e8811a6ee8fb08bc13` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.278238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402131cb-8e8c-466b-bbde-62cd057f64d1 None admin] RBAC: Authorizing `identity:get_user(user_id=850f364cf2ae41e8811a6ee8fb08bc13)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:04.279782 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402131cb-8e8c-466b-bbde-62cd057f64d1 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:04.286020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 166/328] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:39:04 2022] GET /identity/v3/users/850f364cf2ae41e8811a6ee8fb08bc13 => generated 293 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:04.286020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402131cb-8e8c-466b-bbde-62cd057f64d1 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:04.340399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22fa2b-0aa0-4b38-9bb0-fb8cf27ee59b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:04.371775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc244e6-038e-4f37-a8a1-da03298ec2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:04.372474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc244e6-038e-4f37-a8a1-da03298ec2ea None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.372738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc244e6-038e-4f37-a8a1-da03298ec2ea None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.373009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc244e6-038e-4f37-a8a1-da03298ec2ea None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.373756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc244e6-038e-4f37-a8a1-da03298ec2ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:04.374103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc244e6-038e-4f37-a8a1-da03298ec2ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:04.375494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc244e6-038e-4f37-a8a1-da03298ec2ea None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:04.379246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402131cb-8e8c-466b-bbde-62cd057f64d1 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:04.383267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 163/329] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:04.384050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc244e6-038e-4f37-a8a1-da03298ec2ea None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:04.411150 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efa044-63d3-40d9-916a-c36907eaf233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:04.412158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efa044-63d3-40d9-916a-c36907eaf233 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.412443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efa044-63d3-40d9-916a-c36907eaf233 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.412716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efa044-63d3-40d9-916a-c36907eaf233 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.413909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efa044-63d3-40d9-916a-c36907eaf233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:04.415387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efa044-63d3-40d9-916a-c36907eaf233 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:04.416983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 167/330] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:04.417728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efa044-63d3-40d9-916a-c36907eaf233 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:04.481451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc244e6-038e-4f37-a8a1-da03298ec2ea None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:04.512498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280263d6-ff66-423b-b98f-22f8e77e4244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:04.513147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280263d6-ff66-423b-b98f-22f8e77e4244 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.513422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280263d6-ff66-423b-b98f-22f8e77e4244 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.513608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efa044-63d3-40d9-916a-c36907eaf233 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:04.513742 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280263d6-ff66-423b-b98f-22f8e77e4244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.514529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280263d6-ff66-423b-b98f-22f8e77e4244 None admin] RBAC: Adding query filter params (role.id=20d2df2c0f34477d842f0e792557bb47, user.id=850f364cf2ae41e8811a6ee8fb08bc13, scope.system=all) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:04.514832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280263d6-ff66-423b-b98f-22f8e77e4244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:04.516260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280263d6-ff66-423b-b98f-22f8e77e4244 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:04.527366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 164/331] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Oct 28 19:39:04 2022] GET /identity/v3/role_assignments?user.id=850f364cf2ae41e8811a6ee8fb08bc13&scope.system=all&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 510 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:04.534604 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280263d6-ff66-423b-b98f-22f8e77e4244 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:04.555382 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871d6de-5ab9-4611-b901-01fadec5b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:04.556291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d6de-5ab9-4611-b901-01fadec5b069 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.556575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d6de-5ab9-4611-b901-01fadec5b069 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.556853 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d6de-5ab9-4611-b901-01fadec5b069 None admin] PATH_INFO: `/v3/users/7dd8038171094437bca407baf3df0ef0` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.558731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871d6de-5ab9-4611-b901-01fadec5b069 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd8038171094437bca407baf3df0ef0)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:04.560568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871d6de-5ab9-4611-b901-01fadec5b069 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:04.563468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 168/332] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:39:04 2022] GET /identity/v3/users/7dd8038171094437bca407baf3df0ef0 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:04.569265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871d6de-5ab9-4611-b901-01fadec5b069 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:04.645558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280263d6-ff66-423b-b98f-22f8e77e4244 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:04.681286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57d34a-c6c0-4150-8ec0-f737e4da5ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:04.681895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d34a-c6c0-4150-8ec0-f737e4da5ca3 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.682199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d34a-c6c0-4150-8ec0-f737e4da5ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.682296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871d6de-5ab9-4611-b901-01fadec5b069 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:04.682489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d34a-c6c0-4150-8ec0-f737e4da5ca3 None admin] PATH_INFO: `/v3/groups` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.683179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57d34a-c6c0-4150-8ec0-f737e4da5ca3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:04.684672 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57d34a-c6c0-4150-8ec0-f737e4da5ca3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:04.701525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 165/333] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Oct 28 19:39:04 2022] POST /identity/v3/groups => generated 226 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:39:04.733532 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808f7c2-72fa-4e5e-9f35-4c311e6ff5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:04.734461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808f7c2-72fa-4e5e-9f35-4c311e6ff5cc None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:04.734741 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808f7c2-72fa-4e5e-9f35-4c311e6ff5cc None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:04.735017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808f7c2-72fa-4e5e-9f35-4c311e6ff5cc None admin] PATH_INFO: `/v3/system/users/7dd8038171094437bca407baf3df0ef0/roles/43312a4c8be340a889e15774cd34870a` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:04.736700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808f7c2-72fa-4e5e-9f35-4c311e6ff5cc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7dd8038171094437bca407baf3df0ef0, role_id=43312a4c8be340a889e15774cd34870a)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:04.738161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808f7c2-72fa-4e5e-9f35-4c311e6ff5cc None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:04.746363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 169/334] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Oct 28 19:39:04 2022] PUT /identity/v3/system/users/7dd8038171094437bca407baf3df0ef0/roles/43312a4c8be340a889e15774cd34870a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:39:07.347250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854ac12-a1b7-4ea5-ba4c-fbd1d02e6411 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:07.347780 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854ac12-a1b7-4ea5-ba4c-fbd1d02e6411 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:07.348079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854ac12-a1b7-4ea5-ba4c-fbd1d02e6411 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:07.350404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 166/335] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:07.355694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2715cb-2193-4ee8-9762-4ead79dcecbe None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:07.356167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2715cb-2193-4ee8-9762-4ead79dcecbe None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:07.356241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2715cb-2193-4ee8-9762-4ead79dcecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:07.380023 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-5e2715cb-2193-4ee8-9762-4ead79dcecbe None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:07.381226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5e2715cb-2193-4ee8-9762-4ead79dcecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:07.465220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 170/336] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:07.501148 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854ac12-a1b7-4ea5-ba4c-fbd1d02e6411 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:07.519997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b109aa-479f-44dd-aafd-7c10bf9c8501 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:07.520342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b109aa-479f-44dd-aafd-7c10bf9c8501 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:07.520549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b109aa-479f-44dd-aafd-7c10bf9c8501 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:07.522744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 171/337] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:07.539057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01584b39-260e-4101-828c-0485f453bd9f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:07.539367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01584b39-260e-4101-828c-0485f453bd9f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:07.539622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01584b39-260e-4101-828c-0485f453bd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:07.580689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-01584b39-260e-4101-828c-0485f453bd9f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:07.583878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-01584b39-260e-4101-828c-0485f453bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:07.667609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854ac12-a1b7-4ea5-ba4c-fbd1d02e6411 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:07.696427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 172/338] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:07.704095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877ccf6-2b2f-4cbd-be0f-ab740c9667a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:07.705067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877ccf6-2b2f-4cbd-be0f-ab740c9667a3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:07.705446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877ccf6-2b2f-4cbd-be0f-ab740c9667a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:07.705838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877ccf6-2b2f-4cbd-be0f-ab740c9667a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:07.716949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877ccf6-2b2f-4cbd-be0f-ab740c9667a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:07.726543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-6877ccf6-2b2f-4cbd-be0f-ab740c9667a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:39:07.728285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 167/339] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:07.733954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01584b39-260e-4101-828c-0485f453bd9f None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:07.734888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877ccf6-2b2f-4cbd-be0f-ab740c9667a3 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:07.837504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877ccf6-2b2f-4cbd-be0f-ab740c9667a3 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:07.877117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087de9d1-e12c-4784-b134-df97cfdd9b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:07.877960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de9d1-e12c-4784-b134-df97cfdd9b96 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:07.878279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de9d1-e12c-4784-b134-df97cfdd9b96 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:07.878557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de9d1-e12c-4784-b134-df97cfdd9b96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:07.900942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087de9d1-e12c-4784-b134-df97cfdd9b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:07.908134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-087de9d1-e12c-4784-b134-df97cfdd9b96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:39:07.909405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 168/340] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:07.917998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087de9d1-e12c-4784-b134-df97cfdd9b96 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:07.946263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01584b39-260e-4101-828c-0485f453bd9f None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:07.984390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf38866-7612-4cc1-9ac3-efbef16db548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:07.985517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf38866-7612-4cc1-9ac3-efbef16db548 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:07.986217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf38866-7612-4cc1-9ac3-efbef16db548 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:07.986637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf38866-7612-4cc1-9ac3-efbef16db548 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:07.988004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf38866-7612-4cc1-9ac3-efbef16db548 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:07.988569 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf38866-7612-4cc1-9ac3-efbef16db548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:07.990129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf38866-7612-4cc1-9ac3-efbef16db548 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:08.000341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 173/341] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:08.004880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227f905-bf87-494c-8f4d-5a275f74316a None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.005495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227f905-bf87-494c-8f4d-5a275f74316a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.006056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227f905-bf87-494c-8f4d-5a275f74316a None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.010929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 174/342] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:39:08.012027 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227f905-bf87-494c-8f4d-5a275f74316a None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:08.110253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087de9d1-e12c-4784-b134-df97cfdd9b96 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:08.161319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227f905-bf87-494c-8f4d-5a275f74316a None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:08.175661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128bb89-80ae-483a-9ebe-fd405bdda8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:08.176354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128bb89-80ae-483a-9ebe-fd405bdda8a0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.176635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128bb89-80ae-483a-9ebe-fd405bdda8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.176909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128bb89-80ae-483a-9ebe-fd405bdda8a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.177660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128bb89-80ae-483a-9ebe-fd405bdda8a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:08.177965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128bb89-80ae-483a-9ebe-fd405bdda8a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:08.179461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128bb89-80ae-483a-9ebe-fd405bdda8a0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:08.197831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 169/343] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:08.197831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b019d-e55f-465a-97fc-e0cd881d1605 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.197831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b019d-e55f-465a-97fc-e0cd881d1605 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.197831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b019d-e55f-465a-97fc-e0cd881d1605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.207167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2c14d-8762-4436-9851-35181cbd3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:08.208455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2c14d-8762-4436-9851-35181cbd3c51 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.208930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2c14d-8762-4436-9851-35181cbd3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.209464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2c14d-8762-4436-9851-35181cbd3c51 None admin] PATH_INFO: `/v3/users/7dd8038171094437bca407baf3df0ef0` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.211888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2c14d-8762-4436-9851-35181cbd3c51 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd8038171094437bca407baf3df0ef0)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:08.213640 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2c14d-8762-4436-9851-35181cbd3c51 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:08.215651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 175/344] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:39:08 2022] GET /identity/v3/users/7dd8038171094437bca407baf3df0ef0 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:08.217988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2c14d-8762-4436-9851-35181cbd3c51 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:08.226111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-844b019d-e55f-465a-97fc-e0cd881d1605 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:08.226111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-844b019d-e55f-465a-97fc-e0cd881d1605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:08.328513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2c14d-8762-4436-9851-35181cbd3c51 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:08.342470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 170/345] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:08.343684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b019d-e55f-465a-97fc-e0cd881d1605 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:08.374687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddbe92-1ae7-4049-85ca-a1a811c6b178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:08.375260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbe92-1ae7-4049-85ca-a1a811c6b178 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.375539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbe92-1ae7-4049-85ca-a1a811c6b178 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.375811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbe92-1ae7-4049-85ca-a1a811c6b178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.442879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddbe92-1ae7-4049-85ca-a1a811c6b178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:08.444273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddbe92-1ae7-4049-85ca-a1a811c6b178 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:08.450828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b019d-e55f-465a-97fc-e0cd881d1605 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:08.486362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7762e59-4126-4d87-9d79-3394d34bbad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:08.487421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7762e59-4126-4d87-9d79-3394d34bbad0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.487896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7762e59-4126-4d87-9d79-3394d34bbad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.488359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7762e59-4126-4d87-9d79-3394d34bbad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.489407 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7762e59-4126-4d87-9d79-3394d34bbad0 None admin] RBAC: Adding query filter params (role.id=43312a4c8be340a889e15774cd34870a, user.id=7dd8038171094437bca407baf3df0ef0, scope.system=all) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:08.490033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7762e59-4126-4d87-9d79-3394d34bbad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:08.491741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7762e59-4126-4d87-9d79-3394d34bbad0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:08.504448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 171/346] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Oct 28 19:39:08 2022] GET /identity/v3/role_assignments?user.id=7dd8038171094437bca407baf3df0ef0&scope.system=all&role.id=43312a4c8be340a889e15774cd34870a => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:08.506030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5b563-d89b-43bd-8ced-00a9f335abc3 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.506514 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5b563-d89b-43bd-8ced-00a9f335abc3 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.506935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5b563-d89b-43bd-8ced-00a9f335abc3 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.509093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 172/347] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:08.510174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5b563-d89b-43bd-8ced-00a9f335abc3 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:08.543917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 176/348] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:08.545287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7675e-f87c-498c-880d-3ec5a843f181 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.545573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7675e-f87c-498c-880d-3ec5a843f181 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.545853 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7675e-f87c-498c-880d-3ec5a843f181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.569982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4af7675e-f87c-498c-880d-3ec5a843f181 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:08.572093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4af7675e-f87c-498c-880d-3ec5a843f181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:08.635174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5b563-d89b-43bd-8ced-00a9f335abc3 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:08.657653 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 177/349] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:08.658993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7675e-f87c-498c-880d-3ec5a843f181 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:08.672373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a7392-e014-400a-be67-0ee2244c6931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:08.673645 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7392-e014-400a-be67-0ee2244c6931 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.673921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7392-e014-400a-be67-0ee2244c6931 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.674221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7392-e014-400a-be67-0ee2244c6931 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.692062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a7392-e014-400a-be67-0ee2244c6931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:08.703449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-261a7392-e014-400a-be67-0ee2244c6931 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:39:08.704656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 173/350] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:08.705504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a7392-e014-400a-be67-0ee2244c6931 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:08.768687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7675e-f87c-498c-880d-3ec5a843f181 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:08.806739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bcaa1-fb75-4ba3-9294-2663017af86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:08.807989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bcaa1-fb75-4ba3-9294-2663017af86e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.808488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bcaa1-fb75-4ba3-9294-2663017af86e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.808963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bcaa1-fb75-4ba3-9294-2663017af86e None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.810390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bcaa1-fb75-4ba3-9294-2663017af86e None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:08.812116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bcaa1-fb75-4ba3-9294-2663017af86e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:08.814446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 178/351] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:08 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:08.815452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bcaa1-fb75-4ba3-9294-2663017af86e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:08.845666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a7392-e014-400a-be67-0ee2244c6931 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:08.902250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9297ba-0959-4bbf-9eca-f078f9db6652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:08.903104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9297ba-0959-4bbf-9eca-f078f9db6652 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.903385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9297ba-0959-4bbf-9eca-f078f9db6652 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.903658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9297ba-0959-4bbf-9eca-f078f9db6652 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.928204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9297ba-0959-4bbf-9eca-f078f9db6652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:08.933340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bcaa1-fb75-4ba3-9294-2663017af86e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:08.940111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-ac9297ba-0959-4bbf-9eca-f078f9db6652 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:39:08.941379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 174/352] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:39:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:08.942195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9297ba-0959-4bbf-9eca-f078f9db6652 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:08.971373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c27110-0487-4506-934b-fdbdff510d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:08.972393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c27110-0487-4506-934b-fdbdff510d7d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:08.972927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c27110-0487-4506-934b-fdbdff510d7d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:08.973407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c27110-0487-4506-934b-fdbdff510d7d None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:08.974630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c27110-0487-4506-934b-fdbdff510d7d None admin] RBAC: Adding query filter params (name=member) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:08.975160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c27110-0487-4506-934b-fdbdff510d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:08.976810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c27110-0487-4506-934b-fdbdff510d7d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:08.988032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 179/353] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:08.989286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c27110-0487-4506-934b-fdbdff510d7d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:09.079873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9297ba-0959-4bbf-9eca-f078f9db6652 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:09.104074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c27110-0487-4506-934b-fdbdff510d7d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:09.116948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bea90-1cfe-4855-9465-b65e61242358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:09.117912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bea90-1cfe-4855-9465-b65e61242358 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.118219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bea90-1cfe-4855-9465-b65e61242358 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.118491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bea90-1cfe-4855-9465-b65e61242358 None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.128063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bea90-1cfe-4855-9465-b65e61242358 None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:09.129538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bea90-1cfe-4855-9465-b65e61242358 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:09.131319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 175/354] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:08 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:09.132100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bea90-1cfe-4855-9465-b65e61242358 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:09.145175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453d1cf-fed8-4beb-91f0-beb0eab92186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:09.146304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d1cf-fed8-4beb-91f0-beb0eab92186 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.146782 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d1cf-fed8-4beb-91f0-beb0eab92186 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.147303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d1cf-fed8-4beb-91f0-beb0eab92186 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.148310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d1cf-fed8-4beb-91f0-beb0eab92186 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:09.148833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d1cf-fed8-4beb-91f0-beb0eab92186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:09.150628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d1cf-fed8-4beb-91f0-beb0eab92186 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:09.161373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 180/355] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:09.162585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453d1cf-fed8-4beb-91f0-beb0eab92186 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:09.235306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bea90-1cfe-4855-9465-b65e61242358 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:09.266482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453d1cf-fed8-4beb-91f0-beb0eab92186 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:09.268812 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c86dc1-6fa3-40df-bb65-cfbaebf381f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:09.269474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c86dc1-6fa3-40df-bb65-cfbaebf381f2 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.269756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c86dc1-6fa3-40df-bb65-cfbaebf381f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.270820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c86dc1-6fa3-40df-bb65-cfbaebf381f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.303652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22ede1-ec85-44d6-9c1d-297a6301a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:09.304683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ede1-ec85-44d6-9c1d-297a6301a294 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.305060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ede1-ec85-44d6-9c1d-297a6301a294 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.305433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ede1-ec85-44d6-9c1d-297a6301a294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.306431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22ede1-ec85-44d6-9c1d-297a6301a294 None admin] RBAC: Adding query filter params (group.id=7f04c08634f24906a46c1d2b7b439360, role.id=20d2df2c0f34477d842f0e792557bb47, scope.project.id=1aca8b3a36e4474591361aeac183f0b4) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:09.306837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22ede1-ec85-44d6-9c1d-297a6301a294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:09.308318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22ede1-ec85-44d6-9c1d-297a6301a294 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:09.315549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 181/356] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Oct 28 19:39:09 2022] GET /identity/v3/role_assignments?group.id=7f04c08634f24906a46c1d2b7b439360&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:09.316486 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22ede1-ec85-44d6-9c1d-297a6301a294 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:09.378422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c86dc1-6fa3-40df-bb65-cfbaebf381f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:09.380161 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c86dc1-6fa3-40df-bb65-cfbaebf381f2 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:09.428046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22ede1-ec85-44d6-9c1d-297a6301a294 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:09.463717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60193c-e1ea-402b-995f-7b9194374c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:09.464419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60193c-e1ea-402b-995f-7b9194374c3b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.464704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60193c-e1ea-402b-995f-7b9194374c3b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.464981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60193c-e1ea-402b-995f-7b9194374c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.487490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 176/357] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:09.488997 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30016ed0-8c5a-4d6c-a630-d5de3e469cd5 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.489378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30016ed0-8c5a-4d6c-a630-d5de3e469cd5 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.489749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30016ed0-8c5a-4d6c-a630-d5de3e469cd5 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.491602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 177/358] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:09.496772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30016ed0-8c5a-4d6c-a630-d5de3e469cd5 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:09.543262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60193c-e1ea-402b-995f-7b9194374c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:09.544825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60193c-e1ea-402b-995f-7b9194374c3b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:09.603071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30016ed0-8c5a-4d6c-a630-d5de3e469cd5 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:09.637500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efbd83-1b5a-4382-8da6-a704e0b15a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:09.638413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbd83-1b5a-4382-8da6-a704e0b15a5d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.638722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbd83-1b5a-4382-8da6-a704e0b15a5d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.638960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbd83-1b5a-4382-8da6-a704e0b15a5d None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.640167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efbd83-1b5a-4382-8da6-a704e0b15a5d None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:09.641624 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efbd83-1b5a-4382-8da6-a704e0b15a5d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:09.643878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 178/359] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:09 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:09.645190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dc6c1-f6f5-4c9a-a4a9-09ef1bd93e87 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.645472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dc6c1-f6f5-4c9a-a4a9-09ef1bd93e87 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.645745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dc6c1-f6f5-4c9a-a4a9-09ef1bd93e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.650225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 182/360] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:09.655925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60193c-e1ea-402b-995f-7b9194374c3b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:09.665153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d59dc6c1-f6f5-4c9a-a4a9-09ef1bd93e87 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:09.666420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d59dc6c1-f6f5-4c9a-a4a9-09ef1bd93e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:09.735528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 179/361] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:09.736450 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dc6c1-f6f5-4c9a-a4a9-09ef1bd93e87 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:09.761489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60193c-e1ea-402b-995f-7b9194374c3b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:09.799113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d5e2d-aca9-4710-a2b7-0064649f5e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:09.799987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d5e2d-aca9-4710-a2b7-0064649f5e0c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.800257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d5e2d-aca9-4710-a2b7-0064649f5e0c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.800529 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d5e2d-aca9-4710-a2b7-0064649f5e0c None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.801730 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d5e2d-aca9-4710-a2b7-0064649f5e0c None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:09.803744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d5e2d-aca9-4710-a2b7-0064649f5e0c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:09.806443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 183/362] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:09 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:09.812333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf335067-7a47-4dcb-a31d-078c5b78d994 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.812621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf335067-7a47-4dcb-a31d-078c5b78d994 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.812900 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf335067-7a47-4dcb-a31d-078c5b78d994 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.818121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 184/363] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:09.818121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf335067-7a47-4dcb-a31d-078c5b78d994 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:09.864173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dc6c1-f6f5-4c9a-a4a9-09ef1bd93e87 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:09.905465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8810-8ece-4f9a-8d5b-54e146aa637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:09.906373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8810-8ece-4f9a-8d5b-54e146aa637d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.906653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8810-8ece-4f9a-8d5b-54e146aa637d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.906921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8810-8ece-4f9a-8d5b-54e146aa637d None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:09.908165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8810-8ece-4f9a-8d5b-54e146aa637d None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:09.909611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8810-8ece-4f9a-8d5b-54e146aa637d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:09.911540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 180/364] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:09 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:09.912102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8810-8ece-4f9a-8d5b-54e146aa637d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:09.943384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf335067-7a47-4dcb-a31d-078c5b78d994 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:09.997740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95905f98-faa9-4ddc-b7ac-6b54071f868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:09.998926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95905f98-faa9-4ddc-b7ac-6b54071f868f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:09.999383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95905f98-faa9-4ddc-b7ac-6b54071f868f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:09.999836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95905f98-faa9-4ddc-b7ac-6b54071f868f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:10.014866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95905f98-faa9-4ddc-b7ac-6b54071f868f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:10.022830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-95905f98-faa9-4ddc-b7ac-6b54071f868f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:39:10.023577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8810-8ece-4f9a-8d5b-54e146aa637d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:10.024360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 185/365] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:39:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:10.025473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990a47c-433a-42dc-b10d-1c3c98f75a75 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:10.025760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990a47c-433a-42dc-b10d-1c3c98f75a75 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:10.026035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990a47c-433a-42dc-b10d-1c3c98f75a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:10.045406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-8990a47c-433a-42dc-b10d-1c3c98f75a75 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:10.046738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8990a47c-433a-42dc-b10d-1c3c98f75a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:10.067083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df5548-98a3-42e3-a355-3bbb61456912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:10.067998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df5548-98a3-42e3-a355-3bbb61456912 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:10.068282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df5548-98a3-42e3-a355-3bbb61456912 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:10.068555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df5548-98a3-42e3-a355-3bbb61456912 None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:10.070693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df5548-98a3-42e3-a355-3bbb61456912 None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:10.072207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df5548-98a3-42e3-a355-3bbb61456912 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:10.073856 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 181/366] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:09 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:10.078205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df5548-98a3-42e3-a355-3bbb61456912 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:10.135908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 186/367] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:10.137230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990a47c-433a-42dc-b10d-1c3c98f75a75 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:10.204896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df5548-98a3-42e3-a355-3bbb61456912 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:10.244422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af814b2e-d6a0-4fa1-96ee-da4a1b1fc806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:10.245099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814b2e-d6a0-4fa1-96ee-da4a1b1fc806 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:10.245381 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814b2e-d6a0-4fa1-96ee-da4a1b1fc806 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:10.245657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814b2e-d6a0-4fa1-96ee-da4a1b1fc806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:10.246547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af814b2e-d6a0-4fa1-96ee-da4a1b1fc806 None admin] RBAC: Adding query filter params (group.id=7f04c08634f24906a46c1d2b7b439360, role.id=20d2df2c0f34477d842f0e792557bb47, scope.project.id=13447c6176fd4fe4bc3cd6079394899c) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:10.246862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af814b2e-d6a0-4fa1-96ee-da4a1b1fc806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:10.248317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af814b2e-d6a0-4fa1-96ee-da4a1b1fc806 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:10.256014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990a47c-433a-42dc-b10d-1c3c98f75a75 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:10.262239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 182/368] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Oct 28 19:39:10 2022] GET /identity/v3/role_assignments?group.id=7f04c08634f24906a46c1d2b7b439360&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:10.263280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af814b2e-d6a0-4fa1-96ee-da4a1b1fc806 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:10.294504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d699f7-cfd6-4e7b-87aa-8a0511b1ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:10.295111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d699f7-cfd6-4e7b-87aa-8a0511b1ceb0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:10.295390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d699f7-cfd6-4e7b-87aa-8a0511b1ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:10.295653 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d699f7-cfd6-4e7b-87aa-8a0511b1ceb0 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:10.296463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d699f7-cfd6-4e7b-87aa-8a0511b1ceb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:10.296706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d699f7-cfd6-4e7b-87aa-8a0511b1ceb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:10.298670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d699f7-cfd6-4e7b-87aa-8a0511b1ceb0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:10.308476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 187/369] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:10.309399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d699f7-cfd6-4e7b-87aa-8a0511b1ceb0 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:10.392730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af814b2e-d6a0-4fa1-96ee-da4a1b1fc806 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:10.431390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69edac-b368-4b7f-b734-2d8c3a68928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:10.433729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69edac-b368-4b7f-b734-2d8c3a68928a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:10.434008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69edac-b368-4b7f-b734-2d8c3a68928a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:10.434363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69edac-b368-4b7f-b734-2d8c3a68928a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:10.434817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d699f7-cfd6-4e7b-87aa-8a0511b1ceb0 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:10.435301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69edac-b368-4b7f-b734-2d8c3a68928a None admin] RBAC: Adding query filter params (group.id=7f04c08634f24906a46c1d2b7b439360, role.id=23f476d154c04684802479843819b199, scope.project.id=1aca8b3a36e4474591361aeac183f0b4) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:10.435578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69edac-b368-4b7f-b734-2d8c3a68928a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:10.437162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69edac-b368-4b7f-b734-2d8c3a68928a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:10.443630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 183/370] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Oct 28 19:39:10 2022] GET /identity/v3/role_assignments?group.id=7f04c08634f24906a46c1d2b7b439360&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=23f476d154c04684802479843819b199 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:10.444675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69edac-b368-4b7f-b734-2d8c3a68928a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:10.488456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f551e4-a595-43a0-8f80-14a52eb042b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:10.489707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f551e4-a595-43a0-8f80-14a52eb042b3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:10.490242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f551e4-a595-43a0-8f80-14a52eb042b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:10.490706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f551e4-a595-43a0-8f80-14a52eb042b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:10.514237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f551e4-a595-43a0-8f80-14a52eb042b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:10.521766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-98f551e4-a595-43a0-8f80-14a52eb042b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:39:10.524004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 188/371] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:10.532860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f551e4-a595-43a0-8f80-14a52eb042b3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:10.577187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69edac-b368-4b7f-b734-2d8c3a68928a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:10.623431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c71d4-6051-4d62-89d3-894940a0bbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:10.624153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c71d4-6051-4d62-89d3-894940a0bbc7 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:10.624434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c71d4-6051-4d62-89d3-894940a0bbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:10.624707 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c71d4-6051-4d62-89d3-894940a0bbc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:10.701430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f551e4-a595-43a0-8f80-14a52eb042b3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:10.714237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c71d4-6051-4d62-89d3-894940a0bbc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:10.715746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c71d4-6051-4d62-89d3-894940a0bbc7 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:10.744503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8ccb4-b0d0-465c-a8c8-764d0f808fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:10.745276 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8ccb4-b0d0-465c-a8c8-764d0f808fbc None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:10.745563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8ccb4-b0d0-465c-a8c8-764d0f808fbc None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:10.745838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8ccb4-b0d0-465c-a8c8-764d0f808fbc None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:10.746650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8ccb4-b0d0-465c-a8c8-764d0f808fbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:10.746954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8ccb4-b0d0-465c-a8c8-764d0f808fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:10.748350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8ccb4-b0d0-465c-a8c8-764d0f808fbc None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:10.764091 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 189/372] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:10.771066 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8ccb4-b0d0-465c-a8c8-764d0f808fbc None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:10.863573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 184/373] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:10.869235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c71d4-6051-4d62-89d3-894940a0bbc7 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:10.898955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8ccb4-b0d0-465c-a8c8-764d0f808fbc None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:10.936048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80dce-f3d3-4281-8bd7-060d5eac6d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:10.937112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80dce-f3d3-4281-8bd7-060d5eac6d16 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:10.937577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80dce-f3d3-4281-8bd7-060d5eac6d16 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:10.938032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80dce-f3d3-4281-8bd7-060d5eac6d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:10.971705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c71d4-6051-4d62-89d3-894940a0bbc7 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:11.006100 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e80dce-f3d3-4281-8bd7-060d5eac6d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:11.008260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e80dce-f3d3-4281-8bd7-060d5eac6d16 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:11.009770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1984ab7-c711-451b-a8fc-6557b47812da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:11.010675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1984ab7-c711-451b-a8fc-6557b47812da None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:11.010952 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1984ab7-c711-451b-a8fc-6557b47812da None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:11.011223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1984ab7-c711-451b-a8fc-6557b47812da None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:11.012803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1984ab7-c711-451b-a8fc-6557b47812da None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:11.013830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1984ab7-c711-451b-a8fc-6557b47812da None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:11.015917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 185/374] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:10 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:11.021287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1984ab7-c711-451b-a8fc-6557b47812da None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:11.118156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 190/375] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:11.122363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80dce-f3d3-4281-8bd7-060d5eac6d16 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:11.126155 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1984ab7-c711-451b-a8fc-6557b47812da None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:11.166908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb2723-50dd-4e7c-b38a-45c7fb09bdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:11.168180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb2723-50dd-4e7c-b38a-45c7fb09bdbf None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:11.168674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb2723-50dd-4e7c-b38a-45c7fb09bdbf None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:11.169136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb2723-50dd-4e7c-b38a-45c7fb09bdbf None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:11.170632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb2723-50dd-4e7c-b38a-45c7fb09bdbf None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:11.172290 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb2723-50dd-4e7c-b38a-45c7fb09bdbf None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:11.174944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 186/376] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:11 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:11.180987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb2723-50dd-4e7c-b38a-45c7fb09bdbf None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:11.244065 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80dce-f3d3-4281-8bd7-060d5eac6d16 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:11.281375 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd131cc1-fd75-4133-98f9-b56b7732a5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:11.282648 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd131cc1-fd75-4133-98f9-b56b7732a5c9 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:11.283502 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd131cc1-fd75-4133-98f9-b56b7732a5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:11.284129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd131cc1-fd75-4133-98f9-b56b7732a5c9 None admin] PATH_INFO: `/v3/projects/62033cd74f1d4b33b3b42a6bdfc49f3f` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:11.285568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd131cc1-fd75-4133-98f9-b56b7732a5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=62033cd74f1d4b33b3b42a6bdfc49f3f)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:11.287554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd131cc1-fd75-4133-98f9-b56b7732a5c9 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:11.289834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 191/377] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:11 2022] GET /identity/v3/projects/62033cd74f1d4b33b3b42a6bdfc49f3f => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:11.296024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd131cc1-fd75-4133-98f9-b56b7732a5c9 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:11.393027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb2723-50dd-4e7c-b38a-45c7fb09bdbf None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:11.404027 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd131cc1-fd75-4133-98f9-b56b7732a5c9 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:11.444178 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d55f10-2fdb-4e2c-9229-41861493f678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:11.445824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55f10-2fdb-4e2c-9229-41861493f678 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:11.446330 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55f10-2fdb-4e2c-9229-41861493f678 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:11.446821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55f10-2fdb-4e2c-9229-41861493f678 None admin] PATH_INFO: `/v3/groups/04ad0e21152d4fe0a60eeb7d53c63582` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:11.452921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f687fee-213c-4c62-877a-2f0457c7c361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:11.453579 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f687fee-213c-4c62-877a-2f0457c7c361 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:11.453906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f687fee-213c-4c62-877a-2f0457c7c361 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:11.454206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f687fee-213c-4c62-877a-2f0457c7c361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:11.454510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d55f10-2fdb-4e2c-9229-41861493f678 None admin] RBAC: Authorizing `identity:get_group(group_id=04ad0e21152d4fe0a60eeb7d53c63582)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:11.455187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f687fee-213c-4c62-877a-2f0457c7c361 None admin] RBAC: Adding query filter params (group.id=7f04c08634f24906a46c1d2b7b439360, role.id=23f476d154c04684802479843819b199, scope.project.id=13447c6176fd4fe4bc3cd6079394899c) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:11.455499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f687fee-213c-4c62-877a-2f0457c7c361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:11.456619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d55f10-2fdb-4e2c-9229-41861493f678 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:11.457097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f687fee-213c-4c62-877a-2f0457c7c361 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:11.458774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 192/378] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:11 2022] GET /identity/v3/groups/04ad0e21152d4fe0a60eeb7d53c63582 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:11.465515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d55f10-2fdb-4e2c-9229-41861493f678 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:11.468872 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 187/379] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Oct 28 19:39:11 2022] GET /identity/v3/role_assignments?group.id=7f04c08634f24906a46c1d2b7b439360&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=23f476d154c04684802479843819b199 => generated 260 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:11.570811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d55f10-2fdb-4e2c-9229-41861493f678 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:11.606834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48db63-f79a-4675-9730-968475c96b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:11.607908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48db63-f79a-4675-9730-968475c96b4e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:11.608389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48db63-f79a-4675-9730-968475c96b4e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:11.608863 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48db63-f79a-4675-9730-968475c96b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:11.609987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48db63-f79a-4675-9730-968475c96b4e None admin] RBAC: Adding query filter params (group.id=04ad0e21152d4fe0a60eeb7d53c63582, role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=62033cd74f1d4b33b3b42a6bdfc49f3f) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:11.610593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48db63-f79a-4675-9730-968475c96b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:11.612397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48db63-f79a-4675-9730-968475c96b4e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:11.619555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 193/380] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Oct 28 19:39:11 2022] GET /identity/v3/role_assignments?group.id=04ad0e21152d4fe0a60eeb7d53c63582&scope.project.id=62033cd74f1d4b33b3b42a6bdfc49f3f&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:12.051659 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c5ce9-9c28-4af7-a3db-08c9f66a135a None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:12.052698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c5ce9-9c28-4af7-a3db-08c9f66a135a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:12.053205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c5ce9-9c28-4af7-a3db-08c9f66a135a None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:12.055601 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 188/381] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:12.062488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c023d31-a82b-4d16-be0c-06ba8187065d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:12.063160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c023d31-a82b-4d16-be0c-06ba8187065d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:12.063634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c023d31-a82b-4d16-be0c-06ba8187065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:12.083211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0c023d31-a82b-4d16-be0c-06ba8187065d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:12.084754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0c023d31-a82b-4d16-be0c-06ba8187065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:12.163567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 194/382] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:12.199311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c5ce9-9c28-4af7-a3db-08c9f66a135a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:12.310765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c5ce9-9c28-4af7-a3db-08c9f66a135a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:12.347280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae20f1-89c5-47e0-813b-e62dce6dab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:12.348440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae20f1-89c5-47e0-813b-e62dce6dab38 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:12.348942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae20f1-89c5-47e0-813b-e62dce6dab38 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:12.349405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae20f1-89c5-47e0-813b-e62dce6dab38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:12.361623 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae20f1-89c5-47e0-813b-e62dce6dab38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:12.370715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-e9ae20f1-89c5-47e0-813b-e62dce6dab38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:39:12.372209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 189/383] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:12.378361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c023d31-a82b-4d16-be0c-06ba8187065d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:12.484465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c023d31-a82b-4d16-be0c-06ba8187065d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:12.523727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374df6b4-b511-4f62-a353-76e8400ec53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:12.524781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374df6b4-b511-4f62-a353-76e8400ec53d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:12.525256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374df6b4-b511-4f62-a353-76e8400ec53d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:12.525728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374df6b4-b511-4f62-a353-76e8400ec53d None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:12.526764 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374df6b4-b511-4f62-a353-76e8400ec53d None admin] RBAC: Adding query filter params (name=member) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:12.527262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374df6b4-b511-4f62-a353-76e8400ec53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:12.528850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374df6b4-b511-4f62-a353-76e8400ec53d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:12.541029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 195/384] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:12.547339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae20f1-89c5-47e0-813b-e62dce6dab38 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:12.678727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae20f1-89c5-47e0-813b-e62dce6dab38 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:12.715541 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f919c-9e06-499e-b433-2626eb18a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:12.716502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f919c-9e06-499e-b433-2626eb18a95e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:12.716783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f919c-9e06-499e-b433-2626eb18a95e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:12.717057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f919c-9e06-499e-b433-2626eb18a95e None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:12.718761 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f919c-9e06-499e-b433-2626eb18a95e None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:12.720219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f919c-9e06-499e-b433-2626eb18a95e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:12.722314 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 190/385] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:12 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:12.727982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374df6b4-b511-4f62-a353-76e8400ec53d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:12.859496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374df6b4-b511-4f62-a353-76e8400ec53d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:12.893901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d125b4b-10d9-4c6b-9698-bd35162ae155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:12.895172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d125b4b-10d9-4c6b-9698-bd35162ae155 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:12.895647 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d125b4b-10d9-4c6b-9698-bd35162ae155 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:12.896129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d125b4b-10d9-4c6b-9698-bd35162ae155 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:12.898408 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d125b4b-10d9-4c6b-9698-bd35162ae155 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:12.900082 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d125b4b-10d9-4c6b-9698-bd35162ae155 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:12.901992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 196/386] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:12 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:12.908004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f919c-9e06-499e-b433-2626eb18a95e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:13.145916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f919c-9e06-499e-b433-2626eb18a95e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:13.203813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf9bb4-d2c7-4e04-bc61-13a9c744df6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:13.204732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf9bb4-d2c7-4e04-bc61-13a9c744df6c None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:13.205049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf9bb4-d2c7-4e04-bc61-13a9c744df6c None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:13.205364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf9bb4-d2c7-4e04-bc61-13a9c744df6c None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4/groups/7f04c08634f24906a46c1d2b7b439360/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:13.211479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf9bb4-d2c7-4e04-bc61-13a9c744df6c None admin] RBAC: Authorizing `identity:create_grant(project_id=1aca8b3a36e4474591361aeac183f0b4, group_id=7f04c08634f24906a46c1d2b7b439360, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:13.213018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf9bb4-d2c7-4e04-bc61-13a9c744df6c None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:13.247041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 191/387] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Oct 28 19:39:12 2022] PUT /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4/groups/7f04c08634f24906a46c1d2b7b439360/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:39:13.681543 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05656e50-e428-4c18-bc3f-8ca3848e4168 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:13.682516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05656e50-e428-4c18-bc3f-8ca3848e4168 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:13.682991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05656e50-e428-4c18-bc3f-8ca3848e4168 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:13.685331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 197/388] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:13.691111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411707a-a8bd-4dc0-800d-8563533db18b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:13.691401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411707a-a8bd-4dc0-800d-8563533db18b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:13.691683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411707a-a8bd-4dc0-800d-8563533db18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:13.709321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-9411707a-a8bd-4dc0-800d-8563533db18b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:13.710697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9411707a-a8bd-4dc0-800d-8563533db18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:13.742584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c3c7-7f6e-4690-a6bb-724da86b15e2 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:13.742917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c3c7-7f6e-4690-a6bb-724da86b15e2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:13.743132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c3c7-7f6e-4690-a6bb-724da86b15e2 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:13.745043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 198/389] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:39:13.756836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccd2c5-483f-4ad5-9884-4e116afaaf4e None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:13.757172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccd2c5-483f-4ad5-9884-4e116afaaf4e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:13.757391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccd2c5-483f-4ad5-9884-4e116afaaf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:13.788344 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 192/390] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:13.803132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b0ccd2c5-483f-4ad5-9884-4e116afaaf4e None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:13.804336 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b0ccd2c5-483f-4ad5-9884-4e116afaaf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:13.809391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411707a-a8bd-4dc0-800d-8563533db18b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:13.904816 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 199/391] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:13.910610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411707a-a8bd-4dc0-800d-8563533db18b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:13.945086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd536eb-f1b0-4017-a729-3c6919cc8ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:13.945898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd536eb-f1b0-4017-a729-3c6919cc8ec8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:13.946183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd536eb-f1b0-4017-a729-3c6919cc8ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:13.946597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd536eb-f1b0-4017-a729-3c6919cc8ec8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:13.949314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccd2c5-483f-4ad5-9884-4e116afaaf4e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:13.957378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd536eb-f1b0-4017-a729-3c6919cc8ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:13.964701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-1cd536eb-f1b0-4017-a729-3c6919cc8ec8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:39:13.970029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 193/392] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:13.972646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd536eb-f1b0-4017-a729-3c6919cc8ec8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:14.071834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd536eb-f1b0-4017-a729-3c6919cc8ec8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:14.090090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccd2c5-483f-4ad5-9884-4e116afaaf4e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:14.107468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99b76c-41df-47dc-8fad-40dd93365077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:14.108157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99b76c-41df-47dc-8fad-40dd93365077 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:14.108438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99b76c-41df-47dc-8fad-40dd93365077 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:14.108708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99b76c-41df-47dc-8fad-40dd93365077 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:14.109461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99b76c-41df-47dc-8fad-40dd93365077 None admin] RBAC: Adding query filter params (name=member) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:14.109764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99b76c-41df-47dc-8fad-40dd93365077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:14.111235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99b76c-41df-47dc-8fad-40dd93365077 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:14.124589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 194/393] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:14.125877 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99b76c-41df-47dc-8fad-40dd93365077 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:14.139704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e0027-40fc-46cd-9bc4-ea35262078c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:14.140544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e0027-40fc-46cd-9bc4-ea35262078c3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:14.140825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e0027-40fc-46cd-9bc4-ea35262078c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:14.141098 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e0027-40fc-46cd-9bc4-ea35262078c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:14.159039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e0027-40fc-46cd-9bc4-ea35262078c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:14.174641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-228e0027-40fc-46cd-9bc4-ea35262078c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:39:14.176216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 200/394] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:39:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:14.181558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e0027-40fc-46cd-9bc4-ea35262078c3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:14.229443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99b76c-41df-47dc-8fad-40dd93365077 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:14.263764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201323d-e1e4-43d4-8c40-a021299290d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:14.264643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201323d-e1e4-43d4-8c40-a021299290d5 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:14.264925 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201323d-e1e4-43d4-8c40-a021299290d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:14.265197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201323d-e1e4-43d4-8c40-a021299290d5 None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:14.266446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201323d-e1e4-43d4-8c40-a021299290d5 None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:14.267937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201323d-e1e4-43d4-8c40-a021299290d5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:14.269764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 195/395] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:14 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:14.275479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201323d-e1e4-43d4-8c40-a021299290d5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:14.362195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e0027-40fc-46cd-9bc4-ea35262078c3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:14.376046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201323d-e1e4-43d4-8c40-a021299290d5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:14.395767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfa532-7082-43cf-a328-ac56dce6d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:14.396449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfa532-7082-43cf-a328-ac56dce6d384 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:14.396729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfa532-7082-43cf-a328-ac56dce6d384 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:14.396993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfa532-7082-43cf-a328-ac56dce6d384 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:14.397754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfa532-7082-43cf-a328-ac56dce6d384 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:14.398053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfa532-7082-43cf-a328-ac56dce6d384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:14.399472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfa532-7082-43cf-a328-ac56dce6d384 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:14.408885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 201/396] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:14.413038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39812c-c569-410c-b0a5-caa5847f0027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:14.414302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39812c-c569-410c-b0a5-caa5847f0027 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:14.414412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfa532-7082-43cf-a328-ac56dce6d384 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:14.414608 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39812c-c569-410c-b0a5-caa5847f0027 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:14.414845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39812c-c569-410c-b0a5-caa5847f0027 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:14.416046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39812c-c569-410c-b0a5-caa5847f0027 None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:14.417581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39812c-c569-410c-b0a5-caa5847f0027 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:14.424512 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 196/397] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:14 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:14.425680 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39812c-c569-410c-b0a5-caa5847f0027 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:14.521034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfa532-7082-43cf-a328-ac56dce6d384 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:14.527626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39812c-c569-410c-b0a5-caa5847f0027 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:14.556060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf511b0-864f-46c7-85f0-34a4174c32fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:14.556941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf511b0-864f-46c7-85f0-34a4174c32fc None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:14.557223 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf511b0-864f-46c7-85f0-34a4174c32fc None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:14.557485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf511b0-864f-46c7-85f0-34a4174c32fc None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:14.558829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf511b0-864f-46c7-85f0-34a4174c32fc None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:14.560306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf511b0-864f-46c7-85f0-34a4174c32fc None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:14.562601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 202/398] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:14 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:14.563756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb0047-224f-4898-93c5-feb4ad321e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:14.564796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb0047-224f-4898-93c5-feb4ad321e68 None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:14.565107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb0047-224f-4898-93c5-feb4ad321e68 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:14.565358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb0047-224f-4898-93c5-feb4ad321e68 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c/groups/7f04c08634f24906a46c1d2b7b439360/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:14.568511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb0047-224f-4898-93c5-feb4ad321e68 None admin] RBAC: Authorizing `identity:create_grant(project_id=13447c6176fd4fe4bc3cd6079394899c, group_id=7f04c08634f24906a46c1d2b7b439360, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:14.568722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf511b0-864f-46c7-85f0-34a4174c32fc None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:14.570222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb0047-224f-4898-93c5-feb4ad321e68 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:14.589909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 197/399] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Oct 28 19:39:14 2022] PUT /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c/groups/7f04c08634f24906a46c1d2b7b439360/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:39:14.680295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf511b0-864f-46c7-85f0-34a4174c32fc None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:14.718593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7de22c-453b-470b-b7bb-6034c18a528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:14.719582 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7de22c-453b-470b-b7bb-6034c18a528b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:14.719869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7de22c-453b-470b-b7bb-6034c18a528b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:14.720146 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7de22c-453b-470b-b7bb-6034c18a528b None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:14.721461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7de22c-453b-470b-b7bb-6034c18a528b None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:14.723020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7de22c-453b-470b-b7bb-6034c18a528b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:14.725153 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 203/400] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:14 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:14.730883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb0047-224f-4898-93c5-feb4ad321e68 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:14.884690 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb0047-224f-4898-93c5-feb4ad321e68 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:14.926695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d42c4-f3d1-4c67-a723-b145bd648b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:14.927597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d42c4-f3d1-4c67-a723-b145bd648b3e None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:14.927869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d42c4-f3d1-4c67-a723-b145bd648b3e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:14.928137 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d42c4-f3d1-4c67-a723-b145bd648b3e None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4/groups/7f04c08634f24906a46c1d2b7b439360/roles/23f476d154c04684802479843819b199` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:14.931054 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d42c4-f3d1-4c67-a723-b145bd648b3e None admin] RBAC: Authorizing `identity:create_grant(project_id=1aca8b3a36e4474591361aeac183f0b4, group_id=7f04c08634f24906a46c1d2b7b439360, role_id=23f476d154c04684802479843819b199)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:14.932456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d42c4-f3d1-4c67-a723-b145bd648b3e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:14.949975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 198/401] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Oct 28 19:39:14 2022] PUT /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4/groups/7f04c08634f24906a46c1d2b7b439360/roles/23f476d154c04684802479843819b199 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:39:15.233920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ba361-aa3d-4e29-b7e6-36c9c1fcbd09 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:15.234281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ba361-aa3d-4e29-b7e6-36c9c1fcbd09 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:15.234465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ba361-aa3d-4e29-b7e6-36c9c1fcbd09 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:15.236197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 204/402] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:15.242806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676b79-3ec7-43c0-82ec-4a08f0810d06 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:15.243466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676b79-3ec7-43c0-82ec-4a08f0810d06 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:15.243466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676b79-3ec7-43c0-82ec-4a08f0810d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:15.267237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-57676b79-3ec7-43c0-82ec-4a08f0810d06 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:15.268507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-57676b79-3ec7-43c0-82ec-4a08f0810d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:15.311969 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2735b4-5034-435b-8445-42e2ad0da18e None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:15.312267 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2735b4-5034-435b-8445-42e2ad0da18e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:15.312520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2735b4-5034-435b-8445-42e2ad0da18e None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:15.314625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 205/403] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:15.319979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020beab-dbd7-4b8f-833a-517794cff0e4 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:15.320263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020beab-dbd7-4b8f-833a-517794cff0e4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:15.320535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020beab-dbd7-4b8f-833a-517794cff0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:15.350682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 199/404] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:15.356632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-5020beab-dbd7-4b8f-833a-517794cff0e4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:15.357820 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5020beab-dbd7-4b8f-833a-517794cff0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:15.387331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676b79-3ec7-43c0-82ec-4a08f0810d06 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:15.468796 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 206/405] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:15.500185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676b79-3ec7-43c0-82ec-4a08f0810d06 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:15.506499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020beab-dbd7-4b8f-833a-517794cff0e4 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:15.543796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0d232-8d98-4b7a-96ee-fd7564072f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:15.544632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0d232-8d98-4b7a-96ee-fd7564072f42 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:15.544915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0d232-8d98-4b7a-96ee-fd7564072f42 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:15.545198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0d232-8d98-4b7a-96ee-fd7564072f42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:15.567454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0d232-8d98-4b7a-96ee-fd7564072f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:15.574964 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-29a0d232-8d98-4b7a-96ee-fd7564072f42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:39:15.591115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 200/406] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:39:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:15.599908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0d232-8d98-4b7a-96ee-fd7564072f42 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:15.705578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0d232-8d98-4b7a-96ee-fd7564072f42 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:15.723857 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020beab-dbd7-4b8f-833a-517794cff0e4 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:15.749610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5e9e-bdbc-4abb-b897-236ae9053758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:15.750369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5e9e-bdbc-4abb-b897-236ae9053758 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:15.750598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5e9e-bdbc-4abb-b897-236ae9053758 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:15.750870 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5e9e-bdbc-4abb-b897-236ae9053758 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:15.751626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5e9e-bdbc-4abb-b897-236ae9053758 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:15.751931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5e9e-bdbc-4abb-b897-236ae9053758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:15.753440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5e9e-bdbc-4abb-b897-236ae9053758 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:15.775499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 201/407] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:15.782427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5e9e-bdbc-4abb-b897-236ae9053758 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:15.784470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47f9d4-de2f-4fe5-8c2a-2d7fbb85a2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:15.785292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47f9d4-de2f-4fe5-8c2a-2d7fbb85a2af None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:15.785776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47f9d4-de2f-4fe5-8c2a-2d7fbb85a2af None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:15.786050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47f9d4-de2f-4fe5-8c2a-2d7fbb85a2af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:15.804805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47f9d4-de2f-4fe5-8c2a-2d7fbb85a2af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:15.812315 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-5a47f9d4-de2f-4fe5-8c2a-2d7fbb85a2af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:39:15.813832 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 207/408] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:15.819440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47f9d4-de2f-4fe5-8c2a-2d7fbb85a2af None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:15.962976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5e9e-bdbc-4abb-b897-236ae9053758 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:15.977930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47f9d4-de2f-4fe5-8c2a-2d7fbb85a2af None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:16.010900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c15aa0-908f-4afb-b0ec-843151fb70d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:16.011703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c15aa0-908f-4afb-b0ec-843151fb70d3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.011981 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c15aa0-908f-4afb-b0ec-843151fb70d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.012254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c15aa0-908f-4afb-b0ec-843151fb70d3 None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.016957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c15aa0-908f-4afb-b0ec-843151fb70d3 None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:16.018926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c15aa0-908f-4afb-b0ec-843151fb70d3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:16.023748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1087e7-d6af-431f-9739-cd8740bf6c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:16.024776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 202/409] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:15 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:16.024886 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1087e7-d6af-431f-9739-cd8740bf6c42 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.025309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1087e7-d6af-431f-9739-cd8740bf6c42 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.026256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c15aa0-908f-4afb-b0ec-843151fb70d3 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:16.026691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1087e7-d6af-431f-9739-cd8740bf6c42 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.027914 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1087e7-d6af-431f-9739-cd8740bf6c42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:16.028225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1087e7-d6af-431f-9739-cd8740bf6c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:16.029639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1087e7-d6af-431f-9739-cd8740bf6c42 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:16.049424 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 208/410] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:16.055451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1087e7-d6af-431f-9739-cd8740bf6c42 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:16.188113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c15aa0-908f-4afb-b0ec-843151fb70d3 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:16.232080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1087e7-d6af-431f-9739-cd8740bf6c42 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:16.247591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513dc15-807e-4b4f-9c1f-f61b25063966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:16.249166 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513dc15-807e-4b4f-9c1f-f61b25063966 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.249675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513dc15-807e-4b4f-9c1f-f61b25063966 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.250166 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513dc15-807e-4b4f-9c1f-f61b25063966 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.252237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513dc15-807e-4b4f-9c1f-f61b25063966 None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:16.253898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513dc15-807e-4b4f-9c1f-f61b25063966 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:16.259006 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 203/411] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:16 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:16.263909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513dc15-807e-4b4f-9c1f-f61b25063966 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:16.300652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a8155-967b-4e5b-8163-f26a731cae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:16.301898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8155-967b-4e5b-8163-f26a731cae88 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.302392 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8155-967b-4e5b-8163-f26a731cae88 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.302877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8155-967b-4e5b-8163-f26a731cae88 None admin] PATH_INFO: `/v3/groups/04ad0e21152d4fe0a60eeb7d53c63582` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.304430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a8155-967b-4e5b-8163-f26a731cae88 None admin] RBAC: Authorizing `identity:get_group(group_id=04ad0e21152d4fe0a60eeb7d53c63582)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:16.306105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a8155-967b-4e5b-8163-f26a731cae88 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:16.309143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 209/412] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:16 2022] GET /identity/v3/groups/04ad0e21152d4fe0a60eeb7d53c63582 => generated 229 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:16.317288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a8155-967b-4e5b-8163-f26a731cae88 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:16.409760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513dc15-807e-4b4f-9c1f-f61b25063966 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:16.442970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a8155-967b-4e5b-8163-f26a731cae88 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:16.451762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df9c31-852a-4729-bf56-8c7188775cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:16.453297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9c31-852a-4729-bf56-8c7188775cd5 None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.453780 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9c31-852a-4729-bf56-8c7188775cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.454565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9c31-852a-4729-bf56-8c7188775cd5 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c/groups/7f04c08634f24906a46c1d2b7b439360/roles/23f476d154c04684802479843819b199` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.458030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df9c31-852a-4729-bf56-8c7188775cd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=13447c6176fd4fe4bc3cd6079394899c, group_id=7f04c08634f24906a46c1d2b7b439360, role_id=23f476d154c04684802479843819b199)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:16.460165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df9c31-852a-4729-bf56-8c7188775cd5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:16.477679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 204/413] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Oct 28 19:39:16 2022] PUT /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c/groups/7f04c08634f24906a46c1d2b7b439360/roles/23f476d154c04684802479843819b199 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:39:16.479243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881e44-7462-4639-a8b6-d894d45d277f None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.479532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881e44-7462-4639-a8b6-d894d45d277f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.479898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881e44-7462-4639-a8b6-d894d45d277f None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.481279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743582cb-7d4c-499e-a35f-fbacc0e9ddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:16.481749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 205/414] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:16.482707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743582cb-7d4c-499e-a35f-fbacc0e9ddad None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.483114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743582cb-7d4c-499e-a35f-fbacc0e9ddad None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.483531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743582cb-7d4c-499e-a35f-fbacc0e9ddad None admin] PATH_INFO: `/v3/projects/62033cd74f1d4b33b3b42a6bdfc49f3f` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.485037 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743582cb-7d4c-499e-a35f-fbacc0e9ddad None admin] RBAC: Authorizing `identity:get_project(project_id=62033cd74f1d4b33b3b42a6bdfc49f3f)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:16.486926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743582cb-7d4c-499e-a35f-fbacc0e9ddad None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:16.487972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc4e64-7c3c-443a-8752-5e45bc3ce2c8 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.488359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc4e64-7c3c-443a-8752-5e45bc3ce2c8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.488759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc4e64-7c3c-443a-8752-5e45bc3ce2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.494273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 210/415] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:16 2022] GET /identity/v3/projects/62033cd74f1d4b33b3b42a6bdfc49f3f => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:16.496058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743582cb-7d4c-499e-a35f-fbacc0e9ddad None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:16.512553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-12cc4e64-7c3c-443a-8752-5e45bc3ce2c8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:16.513767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-12cc4e64-7c3c-443a-8752-5e45bc3ce2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:16.594377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 206/416] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:16.613810 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc4e64-7c3c-443a-8752-5e45bc3ce2c8 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:16.626265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743582cb-7d4c-499e-a35f-fbacc0e9ddad None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:16.685046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21957657-ce8b-4a25-bce5-e283953fe1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:16.687061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21957657-ce8b-4a25-bce5-e283953fe1ba None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.687491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21957657-ce8b-4a25-bce5-e283953fe1ba None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.687909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21957657-ce8b-4a25-bce5-e283953fe1ba None admin] PATH_INFO: `/v3/projects/62033cd74f1d4b33b3b42a6bdfc49f3f/groups/04ad0e21152d4fe0a60eeb7d53c63582/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.691237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21957657-ce8b-4a25-bce5-e283953fe1ba None admin] RBAC: Authorizing `identity:create_grant(project_id=62033cd74f1d4b33b3b42a6bdfc49f3f, group_id=04ad0e21152d4fe0a60eeb7d53c63582, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:16.692856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21957657-ce8b-4a25-bce5-e283953fe1ba None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:16.719538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 211/417] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Oct 28 19:39:16 2022] PUT /identity/v3/projects/62033cd74f1d4b33b3b42a6bdfc49f3f/groups/04ad0e21152d4fe0a60eeb7d53c63582/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:39:16.736100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc4e64-7c3c-443a-8752-5e45bc3ce2c8 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:16.783582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1861d9-20b0-47cf-be13-6910a829bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:16.784483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1861d9-20b0-47cf-be13-6910a829bda8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.784767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1861d9-20b0-47cf-be13-6910a829bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.785091 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1861d9-20b0-47cf-be13-6910a829bda8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.800062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1861d9-20b0-47cf-be13-6910a829bda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:16.807851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-3a1861d9-20b0-47cf-be13-6910a829bda8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:39:16.809458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 207/418] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:16.815874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21957657-ce8b-4a25-bce5-e283953fe1ba None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:16.927297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21957657-ce8b-4a25-bce5-e283953fe1ba None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:16.962731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9214c3-c909-4ec9-94b3-7f69999c933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:16.963486 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9214c3-c909-4ec9-94b3-7f69999c933e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:16.963770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9214c3-c909-4ec9-94b3-7f69999c933e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:16.964033 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9214c3-c909-4ec9-94b3-7f69999c933e None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:16.964791 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9214c3-c909-4ec9-94b3-7f69999c933e None admin] RBAC: Adding query filter params (name=member) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:16.965094 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9214c3-c909-4ec9-94b3-7f69999c933e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:16.966591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9214c3-c909-4ec9-94b3-7f69999c933e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:16.977827 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 212/419] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:16.981871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1861d9-20b0-47cf-be13-6910a829bda8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:17.094728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1861d9-20b0-47cf-be13-6910a829bda8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:17.136814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7935095-190c-4a9a-9fcb-a9474ef1c3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:17.137480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7935095-190c-4a9a-9fcb-a9474ef1c3ca None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:17.137809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7935095-190c-4a9a-9fcb-a9474ef1c3ca None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:17.138110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7935095-190c-4a9a-9fcb-a9474ef1c3ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:17.224490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7935095-190c-4a9a-9fcb-a9474ef1c3ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:17.225954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7935095-190c-4a9a-9fcb-a9474ef1c3ca None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:17.345526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 208/420] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:17.351100 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9214c3-c909-4ec9-94b3-7f69999c933e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:17.507378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9214c3-c909-4ec9-94b3-7f69999c933e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:17.559686 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6fa4b-fcfb-4b1a-9cc9-daeb2c948359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:17.560575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fa4b-fcfb-4b1a-9cc9-daeb2c948359 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:17.560863 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fa4b-fcfb-4b1a-9cc9-daeb2c948359 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:17.561118 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fa4b-fcfb-4b1a-9cc9-daeb2c948359 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:17.562364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6fa4b-fcfb-4b1a-9cc9-daeb2c948359 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:17.563796 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6fa4b-fcfb-4b1a-9cc9-daeb2c948359 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:17.565925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 213/421] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:17 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:17.571469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7935095-190c-4a9a-9fcb-a9474ef1c3ca None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:17.612059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9abda7-c48f-45a9-8b20-929595a51bd1 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:17.612403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9abda7-c48f-45a9-8b20-929595a51bd1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:17.612598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9abda7-c48f-45a9-8b20-929595a51bd1 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:17.614628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 214/422] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:17.619469 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692304-aa1c-4052-9749-7afba6141e18 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:17.619752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692304-aa1c-4052-9749-7afba6141e18 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:17.620025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692304-aa1c-4052-9749-7afba6141e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:17.655198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-11692304-aa1c-4052-9749-7afba6141e18 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:17.658689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-11692304-aa1c-4052-9749-7afba6141e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:17.705551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7935095-190c-4a9a-9fcb-a9474ef1c3ca None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:17.728766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 215/423] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:17.760689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc3e5b-e3bb-47bc-8c1a-7cc4c036939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:17.760872 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692304-aa1c-4052-9749-7afba6141e18 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:17.761493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3e5b-e3bb-47bc-8c1a-7cc4c036939e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:17.761767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3e5b-e3bb-47bc-8c1a-7cc4c036939e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:17.762034 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3e5b-e3bb-47bc-8c1a-7cc4c036939e None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:17.763287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc3e5b-e3bb-47bc-8c1a-7cc4c036939e None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:17.764729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc3e5b-e3bb-47bc-8c1a-7cc4c036939e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:17.766719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 209/424] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:17 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:17.773118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc3e5b-e3bb-47bc-8c1a-7cc4c036939e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:17.900326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc3e5b-e3bb-47bc-8c1a-7cc4c036939e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:17.940828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ebc8-06f0-470a-ac98-640e45214d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:17.942039 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ebc8-06f0-470a-ac98-640e45214d70 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:17.942537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ebc8-06f0-470a-ac98-640e45214d70 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:17.943042 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ebc8-06f0-470a-ac98-640e45214d70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:17.944096 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ebc8-06f0-470a-ac98-640e45214d70 None admin] RBAC: Adding query filter params (group.id=7f04c08634f24906a46c1d2b7b439360, role.id=20d2df2c0f34477d842f0e792557bb47, scope.project.id=1aca8b3a36e4474591361aeac183f0b4) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:17.944615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ebc8-06f0-470a-ac98-640e45214d70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:17.946266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ebc8-06f0-470a-ac98-640e45214d70 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:17.957606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 210/425] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Oct 28 19:39:17 2022] GET /identity/v3/role_assignments?group.id=7f04c08634f24906a46c1d2b7b439360&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:17.961341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692304-aa1c-4052-9749-7afba6141e18 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:18.005141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27802e78-a08c-49ca-aa20-1e8aa8099134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:18.005952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802e78-a08c-49ca-aa20-1e8aa8099134 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:18.006254 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802e78-a08c-49ca-aa20-1e8aa8099134 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:18.006522 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802e78-a08c-49ca-aa20-1e8aa8099134 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:18.016987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27802e78-a08c-49ca-aa20-1e8aa8099134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:18.024182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-27802e78-a08c-49ca-aa20-1e8aa8099134 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:39:18.025777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 216/426] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:18.031623 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ebc8-06f0-470a-ac98-640e45214d70 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:18.045162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483385-03d4-4a78-9678-3269b17c36b9 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:18.045482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483385-03d4-4a78-9678-3269b17c36b9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:18.045717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483385-03d4-4a78-9678-3269b17c36b9 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:18.048416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 217/427] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:18.055848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15abd93-4275-411c-b910-2a1aa0823b81 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:18.056195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15abd93-4275-411c-b910-2a1aa0823b81 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:18.056397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15abd93-4275-411c-b910-2a1aa0823b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:18.075610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f15abd93-4275-411c-b910-2a1aa0823b81 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:18.076810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f15abd93-4275-411c-b910-2a1aa0823b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:18.209363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 218/428] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:18.225717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ebc8-06f0-470a-ac98-640e45214d70 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:18.232822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15abd93-4275-411c-b910-2a1aa0823b81 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:18.269268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19755c-86fe-47f9-bbe8-7a8e7e1d0939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:18.269871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19755c-86fe-47f9-bbe8-7a8e7e1d0939 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:18.270212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19755c-86fe-47f9-bbe8-7a8e7e1d0939 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:18.270629 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19755c-86fe-47f9-bbe8-7a8e7e1d0939 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:18.271561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19755c-86fe-47f9-bbe8-7a8e7e1d0939 None admin] RBAC: Adding query filter params (name=member) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:18.271872 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19755c-86fe-47f9-bbe8-7a8e7e1d0939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:18.274199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19755c-86fe-47f9-bbe8-7a8e7e1d0939 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:18.285595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 211/429] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:39:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:18.291581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19755c-86fe-47f9-bbe8-7a8e7e1d0939 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:18.345739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15abd93-4275-411c-b910-2a1aa0823b81 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:18.383658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37432acc-2d01-44b9-b8ae-8f10282552d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:18.385692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432acc-2d01-44b9-b8ae-8f10282552d2 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:18.386228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432acc-2d01-44b9-b8ae-8f10282552d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:18.386697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432acc-2d01-44b9-b8ae-8f10282552d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:18.399650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37432acc-2d01-44b9-b8ae-8f10282552d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:18.409638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-37432acc-2d01-44b9-b8ae-8f10282552d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:39:18.412018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 219/430] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:39:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:18.418225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37432acc-2d01-44b9-b8ae-8f10282552d2 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:18.422836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19755c-86fe-47f9-bbe8-7a8e7e1d0939 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:18.474195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fe9a3-2e1f-469c-9d34-f96d7ecbe22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:18.475058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fe9a3-2e1f-469c-9d34-f96d7ecbe22a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:18.475455 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fe9a3-2e1f-469c-9d34-f96d7ecbe22a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:18.475866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fe9a3-2e1f-469c-9d34-f96d7ecbe22a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:18.523134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37432acc-2d01-44b9-b8ae-8f10282552d2 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:18.549486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fe9a3-2e1f-469c-9d34-f96d7ecbe22a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:18.551013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fe9a3-2e1f-469c-9d34-f96d7ecbe22a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:18.557322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3266a-1f51-4a70-91f7-bc8cac4125b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:18.558316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3266a-1f51-4a70-91f7-bc8cac4125b6 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:18.558795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3266a-1f51-4a70-91f7-bc8cac4125b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:18.559278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3266a-1f51-4a70-91f7-bc8cac4125b6 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:18.560248 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3266a-1f51-4a70-91f7-bc8cac4125b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:18.560745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3266a-1f51-4a70-91f7-bc8cac4125b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:18.562371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3266a-1f51-4a70-91f7-bc8cac4125b6 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:18.571340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 220/431] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:18.577142 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3266a-1f51-4a70-91f7-bc8cac4125b6 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:18.654552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 212/432] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:18.663200 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fe9a3-2e1f-469c-9d34-f96d7ecbe22a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:18.676532 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3266a-1f51-4a70-91f7-bc8cac4125b6 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:18.710772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4023c-d707-4419-b904-50e3d69685d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:18.711910 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4023c-d707-4419-b904-50e3d69685d5 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:18.712391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4023c-d707-4419-b904-50e3d69685d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:18.712852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4023c-d707-4419-b904-50e3d69685d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:18.764087 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fe9a3-2e1f-469c-9d34-f96d7ecbe22a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:18.782847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4023c-d707-4419-b904-50e3d69685d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:18.784690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4023c-d707-4419-b904-50e3d69685d5 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:18.799223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac24165-fcba-4b22-8dc5-6e30d752af36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:18.800297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac24165-fcba-4b22-8dc5-6e30d752af36 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:18.800574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac24165-fcba-4b22-8dc5-6e30d752af36 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:18.800842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac24165-fcba-4b22-8dc5-6e30d752af36 None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:18.802056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac24165-fcba-4b22-8dc5-6e30d752af36 None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:18.803540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac24165-fcba-4b22-8dc5-6e30d752af36 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:18.805650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 213/433] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:18 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:18.815086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac24165-fcba-4b22-8dc5-6e30d752af36 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:18.897298 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 221/434] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:18.905129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4023c-d707-4419-b904-50e3d69685d5 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:18.938040 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac24165-fcba-4b22-8dc5-6e30d752af36 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:18.973730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181dc77-ea76-4e64-b842-4ba3875334e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:18.974983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181dc77-ea76-4e64-b842-4ba3875334e3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:18.975455 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181dc77-ea76-4e64-b842-4ba3875334e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:18.975936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181dc77-ea76-4e64-b842-4ba3875334e3 None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:18.979233 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181dc77-ea76-4e64-b842-4ba3875334e3 None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:18.980914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181dc77-ea76-4e64-b842-4ba3875334e3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:18.983094 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 214/435] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:18 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:18.989099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181dc77-ea76-4e64-b842-4ba3875334e3 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:19.011329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4023c-d707-4419-b904-50e3d69685d5 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:19.050835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd16b6-32f3-42a3-8634-098660959c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:19.051690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd16b6-32f3-42a3-8634-098660959c25 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.051973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd16b6-32f3-42a3-8634-098660959c25 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.052242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd16b6-32f3-42a3-8634-098660959c25 None admin] PATH_INFO: `/v3/projects/1aca8b3a36e4474591361aeac183f0b4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.053846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd16b6-32f3-42a3-8634-098660959c25 None admin] RBAC: Authorizing `identity:get_project(project_id=1aca8b3a36e4474591361aeac183f0b4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:19.055393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd16b6-32f3-42a3-8634-098660959c25 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:19.057405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 222/436] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:18 2022] GET /identity/v3/projects/1aca8b3a36e4474591361aeac183f0b4 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:19.062871 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd16b6-32f3-42a3-8634-098660959c25 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:19.120278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181dc77-ea76-4e64-b842-4ba3875334e3 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:19.161640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2a76-3455-43ba-9125-dfc33df41933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:19.162349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2a76-3455-43ba-9125-dfc33df41933 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.162633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2a76-3455-43ba-9125-dfc33df41933 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.163072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2a76-3455-43ba-9125-dfc33df41933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.163728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb2a76-3455-43ba-9125-dfc33df41933 None admin] RBAC: Adding query filter params (group.id=7f04c08634f24906a46c1d2b7b439360, role.id=20d2df2c0f34477d842f0e792557bb47, scope.project.id=13447c6176fd4fe4bc3cd6079394899c) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:19.164036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb2a76-3455-43ba-9125-dfc33df41933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:19.165478 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb2a76-3455-43ba-9125-dfc33df41933 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:19.171493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 215/437] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Oct 28 19:39:18 2022] GET /identity/v3/role_assignments?group.id=7f04c08634f24906a46c1d2b7b439360&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=20d2df2c0f34477d842f0e792557bb47 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:19.181032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd16b6-32f3-42a3-8634-098660959c25 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:19.220480 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e27e7d-8297-439d-a6c5-d06307aeb179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:19.222005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e27e7d-8297-439d-a6c5-d06307aeb179 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.222552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e27e7d-8297-439d-a6c5-d06307aeb179 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.223018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e27e7d-8297-439d-a6c5-d06307aeb179 None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.224661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e27e7d-8297-439d-a6c5-d06307aeb179 None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:19.226491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e27e7d-8297-439d-a6c5-d06307aeb179 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:19.229009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 223/438] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:19 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:19.235104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2a76-3455-43ba-9125-dfc33df41933 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:19.345163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2a76-3455-43ba-9125-dfc33df41933 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:19.381035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfa521-72ba-4119-9fbf-0d2fe52c2517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:19.381698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfa521-72ba-4119-9fbf-0d2fe52c2517 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.381976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfa521-72ba-4119-9fbf-0d2fe52c2517 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.382276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfa521-72ba-4119-9fbf-0d2fe52c2517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.383111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfa521-72ba-4119-9fbf-0d2fe52c2517 None admin] RBAC: Adding query filter params (group.id=7f04c08634f24906a46c1d2b7b439360, role.id=23f476d154c04684802479843819b199, scope.project.id=1aca8b3a36e4474591361aeac183f0b4) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:19.383414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfa521-72ba-4119-9fbf-0d2fe52c2517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:19.384895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfa521-72ba-4119-9fbf-0d2fe52c2517 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:19.391019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 216/439] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Oct 28 19:39:19 2022] GET /identity/v3/role_assignments?group.id=7f04c08634f24906a46c1d2b7b439360&scope.project.id=1aca8b3a36e4474591361aeac183f0b4&role.id=23f476d154c04684802479843819b199 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:19.423819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1928c73-2ba1-415b-bb52-6bf0d621ae03 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.424597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1928c73-2ba1-415b-bb52-6bf0d621ae03 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.424870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1928c73-2ba1-415b-bb52-6bf0d621ae03 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.427010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 224/440] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:19.433426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a35a-1d93-45d4-b557-621c622be798 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.434365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a35a-1d93-45d4-b557-621c622be798 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.434816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a35a-1d93-45d4-b557-621c622be798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.454648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-22c5a35a-1d93-45d4-b557-621c622be798 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:19.455996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-22c5a35a-1d93-45d4-b557-621c622be798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:19.528763 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 217/441] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:19.552056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1928c73-2ba1-415b-bb52-6bf0d621ae03 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:19.601565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1dd6b-fc67-496e-a598-334e8e05e643 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.601898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1dd6b-fc67-496e-a598-334e8e05e643 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.602284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1dd6b-fc67-496e-a598-334e8e05e643 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.604363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 218/442] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:39:19.609605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e889c3-af44-43f3-888c-0c3b0f17c23c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.609892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e889c3-af44-43f3-888c-0c3b0f17c23c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.610241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e889c3-af44-43f3-888c-0c3b0f17c23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.629022 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-09e889c3-af44-43f3-888c-0c3b0f17c23c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:19.630560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-09e889c3-af44-43f3-888c-0c3b0f17c23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:19.661282 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1928c73-2ba1-415b-bb52-6bf0d621ae03 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:19.702127 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced83e02-a44d-4877-a370-e097f9198824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:19.702979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced83e02-a44d-4877-a370-e097f9198824 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.703260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced83e02-a44d-4877-a370-e097f9198824 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.703533 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced83e02-a44d-4877-a370-e097f9198824 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.706656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 219/443] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:19.715380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced83e02-a44d-4877-a370-e097f9198824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:19.723138 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-ced83e02-a44d-4877-a370-e097f9198824 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:39:19.724526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 225/444] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:39:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:19.730340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e889c3-af44-43f3-888c-0c3b0f17c23c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:19.730556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced83e02-a44d-4877-a370-e097f9198824 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:19.838134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced83e02-a44d-4877-a370-e097f9198824 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:19.840758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e889c3-af44-43f3-888c-0c3b0f17c23c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:19.876622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45bc1-604c-49b2-8817-d7b1bff6d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:19.876806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bc620-8a78-415f-958c-520b2f21b195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:19.877205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45bc1-604c-49b2-8817-d7b1bff6d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.877520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bc620-8a78-415f-958c-520b2f21b195 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:19.877631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45bc1-604c-49b2-8817-d7b1bff6d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.877798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bc620-8a78-415f-958c-520b2f21b195 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:19.877890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45bc1-604c-49b2-8817-d7b1bff6d2b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.878067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bc620-8a78-415f-958c-520b2f21b195 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:19.878849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bc620-8a78-415f-958c-520b2f21b195 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:19.879175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bc620-8a78-415f-958c-520b2f21b195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:19.880553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bc620-8a78-415f-958c-520b2f21b195 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:19.888830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 220/445] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:19.891346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a45bc1-604c-49b2-8817-d7b1bff6d2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:19.894643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bc620-8a78-415f-958c-520b2f21b195 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:19.898738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-f5a45bc1-604c-49b2-8817-d7b1bff6d2b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:39:19.900263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 226/446] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:19.907052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45bc1-604c-49b2-8817-d7b1bff6d2b2 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:19.994098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bc620-8a78-415f-958c-520b2f21b195 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:20.005797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45bc1-604c-49b2-8817-d7b1bff6d2b2 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:20.026424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36e1f2-73cb-425a-8da5-894290626db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:20.027074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36e1f2-73cb-425a-8da5-894290626db3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:20.027350 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36e1f2-73cb-425a-8da5-894290626db3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:20.027617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36e1f2-73cb-425a-8da5-894290626db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:20.037193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f6faf-1bab-4958-9be3-8ad4b8757e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:20.037860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f6faf-1bab-4958-9be3-8ad4b8757e58 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:20.038188 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f6faf-1bab-4958-9be3-8ad4b8757e58 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:20.038462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f6faf-1bab-4958-9be3-8ad4b8757e58 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:20.039208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f6faf-1bab-4958-9be3-8ad4b8757e58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:20.039512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f6faf-1bab-4958-9be3-8ad4b8757e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:20.040890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f6faf-1bab-4958-9be3-8ad4b8757e58 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:20.048685 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 227/447] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:20.054669 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f6faf-1bab-4958-9be3-8ad4b8757e58 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:20.092733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36e1f2-73cb-425a-8da5-894290626db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:20.094261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36e1f2-73cb-425a-8da5-894290626db3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:20.147441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f6faf-1bab-4958-9be3-8ad4b8757e58 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:20.180495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ffd17-a09c-4c91-9c50-89e48d4ae901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:20.181251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ffd17-a09c-4c91-9c50-89e48d4ae901 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:20.181524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ffd17-a09c-4c91-9c50-89e48d4ae901 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:20.181788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ffd17-a09c-4c91-9c50-89e48d4ae901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:20.194641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 221/448] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:20.200368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36e1f2-73cb-425a-8da5-894290626db3 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:20.247203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ffd17-a09c-4c91-9c50-89e48d4ae901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:20.248677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ffd17-a09c-4c91-9c50-89e48d4ae901 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:20.294000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36e1f2-73cb-425a-8da5-894290626db3 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:20.326662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e78f7b-e866-47b2-bac4-1639a933009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:20.327566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e78f7b-e866-47b2-bac4-1639a933009a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:20.327833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e78f7b-e866-47b2-bac4-1639a933009a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:20.328101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e78f7b-e866-47b2-bac4-1639a933009a None admin] PATH_INFO: `/v3/projects/13447c6176fd4fe4bc3cd6079394899c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:20.329313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e78f7b-e866-47b2-bac4-1639a933009a None admin] RBAC: Authorizing `identity:get_project(project_id=13447c6176fd4fe4bc3cd6079394899c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:20.330874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e78f7b-e866-47b2-bac4-1639a933009a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:20.332530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 222/449] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:20 2022] GET /identity/v3/projects/13447c6176fd4fe4bc3cd6079394899c => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:20.338263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e78f7b-e866-47b2-bac4-1639a933009a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:20.343823 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 228/450] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:20.349306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ffd17-a09c-4c91-9c50-89e48d4ae901 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:20.433194 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e78f7b-e866-47b2-bac4-1639a933009a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:20.443520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ffd17-a09c-4c91-9c50-89e48d4ae901 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:20.465371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c037fec-d679-4f2a-b868-fd822cb64495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:20.466266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c037fec-d679-4f2a-b868-fd822cb64495 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:20.466545 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c037fec-d679-4f2a-b868-fd822cb64495 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:20.466817 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c037fec-d679-4f2a-b868-fd822cb64495 None admin] PATH_INFO: `/v3/groups/7f04c08634f24906a46c1d2b7b439360` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:20.468014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c037fec-d679-4f2a-b868-fd822cb64495 None admin] RBAC: Authorizing `identity:get_group(group_id=7f04c08634f24906a46c1d2b7b439360)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:20.469463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c037fec-d679-4f2a-b868-fd822cb64495 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:20.471113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 223/451] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:20 2022] GET /identity/v3/groups/7f04c08634f24906a46c1d2b7b439360 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:20.476586 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578529d1-1a8e-4808-8404-f01fc96c8a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:20.477062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c037fec-d679-4f2a-b868-fd822cb64495 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:20.477443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578529d1-1a8e-4808-8404-f01fc96c8a85 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:20.477715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578529d1-1a8e-4808-8404-f01fc96c8a85 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:20.477984 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578529d1-1a8e-4808-8404-f01fc96c8a85 None admin] PATH_INFO: `/v3/projects/62033cd74f1d4b33b3b42a6bdfc49f3f` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:20.479160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578529d1-1a8e-4808-8404-f01fc96c8a85 None admin] RBAC: Authorizing `identity:get_project(project_id=62033cd74f1d4b33b3b42a6bdfc49f3f)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:20.480590 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578529d1-1a8e-4808-8404-f01fc96c8a85 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:20.482265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 229/452] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:39:20 2022] GET /identity/v3/projects/62033cd74f1d4b33b3b42a6bdfc49f3f => generated 344 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:20.487622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578529d1-1a8e-4808-8404-f01fc96c8a85 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:20.573677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c037fec-d679-4f2a-b868-fd822cb64495 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:20.577674 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578529d1-1a8e-4808-8404-f01fc96c8a85 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:20.607898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af72719-1b8c-43cd-95f7-305467e825a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:20.608556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af72719-1b8c-43cd-95f7-305467e825a3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:20.608838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af72719-1b8c-43cd-95f7-305467e825a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:20.609112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af72719-1b8c-43cd-95f7-305467e825a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:20.609306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed201df-6929-4152-89b4-1694faf49728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:20.609944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af72719-1b8c-43cd-95f7-305467e825a3 None admin] RBAC: Adding query filter params (group.id=7f04c08634f24906a46c1d2b7b439360, role.id=23f476d154c04684802479843819b199, scope.project.id=13447c6176fd4fe4bc3cd6079394899c) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:20.610032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed201df-6929-4152-89b4-1694faf49728 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:20.610284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed201df-6929-4152-89b4-1694faf49728 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:20.610368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af72719-1b8c-43cd-95f7-305467e825a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:20.610555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed201df-6929-4152-89b4-1694faf49728 None admin] PATH_INFO: `/v3/groups/04ad0e21152d4fe0a60eeb7d53c63582` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:20.611724 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af72719-1b8c-43cd-95f7-305467e825a3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:20.611841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed201df-6929-4152-89b4-1694faf49728 None admin] RBAC: Authorizing `identity:get_group(group_id=04ad0e21152d4fe0a60eeb7d53c63582)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:20.613166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed201df-6929-4152-89b4-1694faf49728 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:20.618141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 230/453] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Oct 28 19:39:20 2022] GET /identity/v3/groups/04ad0e21152d4fe0a60eeb7d53c63582 => generated 229 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:20.618295 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 224/454] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Oct 28 19:39:20 2022] GET /identity/v3/role_assignments?group.id=7f04c08634f24906a46c1d2b7b439360&scope.project.id=13447c6176fd4fe4bc3cd6079394899c&role.id=23f476d154c04684802479843819b199 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:20.620559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed201df-6929-4152-89b4-1694faf49728 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:20.727811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed201df-6929-4152-89b4-1694faf49728 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:20.761659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77e38f-b4eb-400e-823a-2a4abbf4c2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:20.762340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77e38f-b4eb-400e-823a-2a4abbf4c2a0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:20.762616 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77e38f-b4eb-400e-823a-2a4abbf4c2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:20.762880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77e38f-b4eb-400e-823a-2a4abbf4c2a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:20.763718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77e38f-b4eb-400e-823a-2a4abbf4c2a0 None admin] RBAC: Adding query filter params (group.id=04ad0e21152d4fe0a60eeb7d53c63582, role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=62033cd74f1d4b33b3b42a6bdfc49f3f) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:20.764011 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77e38f-b4eb-400e-823a-2a4abbf4c2a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:20.765466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77e38f-b4eb-400e-823a-2a4abbf4c2a0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:20.771838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 231/455] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Oct 28 19:39:20 2022] GET /identity/v3/role_assignments?group.id=04ad0e21152d4fe0a60eeb7d53c63582&scope.project.id=62033cd74f1d4b33b3b42a6bdfc49f3f&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:23.633331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfaadd-7f3e-40cf-88aa-672ecd23d495 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:23.634422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfaadd-7f3e-40cf-88aa-672ecd23d495 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:23.634913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfaadd-7f3e-40cf-88aa-672ecd23d495 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:23.637170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 225/456] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:23.640002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a3732-9f14-42f2-8cb8-3a22af7f586e None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:23.640870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a3732-9f14-42f2-8cb8-3a22af7f586e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:23.641415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a3732-9f14-42f2-8cb8-3a22af7f586e None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:23.643512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 232/457] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:23.649108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed49de5-dfb7-4049-b70b-48fcef003897 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:23.649568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed49de5-dfb7-4049-b70b-48fcef003897 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:23.649939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735b47f-d5da-4d13-83d7-2de337a27f8d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:23.650388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735b47f-d5da-4d13-83d7-2de337a27f8d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:23.650797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed49de5-dfb7-4049-b70b-48fcef003897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:23.651204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735b47f-d5da-4d13-83d7-2de337a27f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:23.684166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-aed49de5-dfb7-4049-b70b-48fcef003897 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:23.685738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-aed49de5-dfb7-4049-b70b-48fcef003897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:23.691269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-2735b47f-d5da-4d13-83d7-2de337a27f8d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:23.692498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2735b47f-d5da-4d13-83d7-2de337a27f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:23.768807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 233/458] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:23.790731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 226/459] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:23.801181 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbe546-96bd-48da-bd9b-d4dda29f3cb8 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:23.801728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbe546-96bd-48da-bd9b-d4dda29f3cb8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:23.802219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbe546-96bd-48da-bd9b-d4dda29f3cb8 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:23.804433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 234/460] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:23.807654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735b47f-d5da-4d13-83d7-2de337a27f8d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:23.809100 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ca60-83a9-4a2a-b313-0ede905ac743 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:23.809582 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ca60-83a9-4a2a-b313-0ede905ac743 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:23.810046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ca60-83a9-4a2a-b313-0ede905ac743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:23.827055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-9854ca60-83a9-4a2a-b313-0ede905ac743 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:23.828546 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9854ca60-83a9-4a2a-b313-0ede905ac743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:23.902855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 235/461] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:23.903660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854ca60-83a9-4a2a-b313-0ede905ac743 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:23.915162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735b47f-d5da-4d13-83d7-2de337a27f8d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:23.950177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa522-69c2-48a8-955a-25eb19526a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:23.951392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa522-69c2-48a8-955a-25eb19526a51 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:23.951887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa522-69c2-48a8-955a-25eb19526a51 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:23.952352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa522-69c2-48a8-955a-25eb19526a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:23.963878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fa522-69c2-48a8-955a-25eb19526a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:23.965732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fa522-69c2-48a8-955a-25eb19526a51 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:23.983702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-aa7fa522-69c2-48a8-955a-25eb19526a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:23.985600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 227/462] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:23.986658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa522-69c2-48a8-955a-25eb19526a51 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:24.006729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854ca60-83a9-4a2a-b313-0ede905ac743 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:24.042432 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4c63c-5da0-48ff-9109-7204eb9029f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:24.043551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4c63c-5da0-48ff-9109-7204eb9029f9 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.044011 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4c63c-5da0-48ff-9109-7204eb9029f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.044426 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4c63c-5da0-48ff-9109-7204eb9029f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.056224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4c63c-5da0-48ff-9109-7204eb9029f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:24.058015 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4c63c-5da0-48ff-9109-7204eb9029f9 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:24.076015 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-63d4c63c-5da0-48ff-9109-7204eb9029f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:24.082196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 236/463] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:24.083252 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4c63c-5da0-48ff-9109-7204eb9029f9 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:24.089424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa522-69c2-48a8-955a-25eb19526a51 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:24.123095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d8376-1747-4450-a526-b84f400372a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:24.124158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d8376-1747-4450-a526-b84f400372a5 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.124596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d8376-1747-4450-a526-b84f400372a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.125071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d8376-1747-4450-a526-b84f400372a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.135799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d8376-1747-4450-a526-b84f400372a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:24.137509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d8376-1747-4450-a526-b84f400372a5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:24.154464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-da1d8376-1747-4450-a526-b84f400372a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:24.156287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 228/464] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:24.157278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d8376-1747-4450-a526-b84f400372a5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:24.184885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4c63c-5da0-48ff-9109-7204eb9029f9 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:24.218330 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5a95c-cc55-48d0-82f6-862215fffb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:24.219348 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5a95c-cc55-48d0-82f6-862215fffb78 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.219849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5a95c-cc55-48d0-82f6-862215fffb78 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.220322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5a95c-cc55-48d0-82f6-862215fffb78 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.221239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5a95c-cc55-48d0-82f6-862215fffb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:24.221790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5a95c-cc55-48d0-82f6-862215fffb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:24.223406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5a95c-cc55-48d0-82f6-862215fffb78 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:24.241524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 237/465] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:24.242838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5a95c-cc55-48d0-82f6-862215fffb78 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:24.256045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d8376-1747-4450-a526-b84f400372a5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:24.289003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a21230-006b-444b-871a-bd157b776084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:24.289917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21230-006b-444b-871a-bd157b776084 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.290392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21230-006b-444b-871a-bd157b776084 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.290804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21230-006b-444b-871a-bd157b776084 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.291742 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a21230-006b-444b-871a-bd157b776084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:24.292223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a21230-006b-444b-871a-bd157b776084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:24.293765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a21230-006b-444b-871a-bd157b776084 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:24.306596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 229/466] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:24.307720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a21230-006b-444b-871a-bd157b776084 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:24.347810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5a95c-cc55-48d0-82f6-862215fffb78 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:24.381334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10978844-f035-45a7-b28d-e065a22c2461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:24.382069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10978844-f035-45a7-b28d-e065a22c2461 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.382374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10978844-f035-45a7-b28d-e065a22c2461 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.382659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10978844-f035-45a7-b28d-e065a22c2461 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.383392 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10978844-f035-45a7-b28d-e065a22c2461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:24.383698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10978844-f035-45a7-b28d-e065a22c2461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:24.385090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10978844-f035-45a7-b28d-e065a22c2461 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:24.396948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 238/467] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:24.397952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10978844-f035-45a7-b28d-e065a22c2461 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:24.410800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a21230-006b-444b-871a-bd157b776084 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:24.445093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdb0eb-57d4-4861-ac5e-fcf1675f79d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:24.445771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdb0eb-57d4-4861-ac5e-fcf1675f79d6 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.446043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdb0eb-57d4-4861-ac5e-fcf1675f79d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.446368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdb0eb-57d4-4861-ac5e-fcf1675f79d6 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.447066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdb0eb-57d4-4861-ac5e-fcf1675f79d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:24.448509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdb0eb-57d4-4861-ac5e-fcf1675f79d6 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:24.468980 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 230/468] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:39:24 2022] POST /identity/v3/users => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:39:24.470624 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b460c-d605-4a5b-a621-c35e308feaac None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.471111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b460c-d605-4a5b-a621-c35e308feaac None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.471622 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b460c-d605-4a5b-a621-c35e308feaac None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.473616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 231/469] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:24.474649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b460c-d605-4a5b-a621-c35e308feaac None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:24.514870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10978844-f035-45a7-b28d-e065a22c2461 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:24.564020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c963a-bbd8-4014-ba36-042a00035df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:24.565356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c963a-bbd8-4014-ba36-042a00035df4 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.565634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c963a-bbd8-4014-ba36-042a00035df4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.566391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c963a-bbd8-4014-ba36-042a00035df4 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.567319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c963a-bbd8-4014-ba36-042a00035df4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:24.570161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c963a-bbd8-4014-ba36-042a00035df4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:24.597249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 239/470] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:39:24 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:39:24.598977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadea362-02de-49fa-b2cb-35c4d61306ba None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.599439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadea362-02de-49fa-b2cb-35c4d61306ba None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.599873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadea362-02de-49fa-b2cb-35c4d61306ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.615242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b460c-d605-4a5b-a621-c35e308feaac None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:24.622581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-aadea362-02de-49fa-b2cb-35c4d61306ba None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:24.624168 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-aadea362-02de-49fa-b2cb-35c4d61306ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:24.685557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3b7cf-87b6-4442-af4b-7f2c384ca256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:24.686226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3b7cf-87b6-4442-af4b-7f2c384ca256 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.686504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3b7cf-87b6-4442-af4b-7f2c384ca256 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.687983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3b7cf-87b6-4442-af4b-7f2c384ca256 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.688839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3b7cf-87b6-4442-af4b-7f2c384ca256 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:24.690537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3b7cf-87b6-4442-af4b-7f2c384ca256 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:24.716187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 232/471] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:39:24 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:39:24.719098 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 240/472] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:24.745745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3b7cf-87b6-4442-af4b-7f2c384ca256 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:24.865093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3b7cf-87b6-4442-af4b-7f2c384ca256 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:24.903165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb1f9-89d6-4c40-894e-d7baf7a3de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:24.903998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb1f9-89d6-4c40-894e-d7baf7a3de45 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:24.904278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb1f9-89d6-4c40-894e-d7baf7a3de45 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:24.904550 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb1f9-89d6-4c40-894e-d7baf7a3de45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:24.916775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdeb1f9-89d6-4c40-894e-d7baf7a3de45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:24.918310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdeb1f9-89d6-4c40-894e-d7baf7a3de45 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:24.936715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-bfdeb1f9-89d6-4c40-894e-d7baf7a3de45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:24.938289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 233/473] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:24.944304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadea362-02de-49fa-b2cb-35c4d61306ba None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:25.047014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadea362-02de-49fa-b2cb-35c4d61306ba None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:25.088739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34982c-0243-47c4-8bc7-4ebdd6689811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:25.089791 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34982c-0243-47c4-8bc7-4ebdd6689811 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:25.090321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34982c-0243-47c4-8bc7-4ebdd6689811 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:25.090785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34982c-0243-47c4-8bc7-4ebdd6689811 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:25.091777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34982c-0243-47c4-8bc7-4ebdd6689811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:25.092640 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34982c-0243-47c4-8bc7-4ebdd6689811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:25.094270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34982c-0243-47c4-8bc7-4ebdd6689811 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:25.107060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 241/474] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:25.112393 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb1f9-89d6-4c40-894e-d7baf7a3de45 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:25.257770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb1f9-89d6-4c40-894e-d7baf7a3de45 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:25.270568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef5315-b86c-48a2-9ceb-db268864b3fc None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:25.270880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef5315-b86c-48a2-9ceb-db268864b3fc None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:25.271141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef5315-b86c-48a2-9ceb-db268864b3fc None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:25.273208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 242/475] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:25.278526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13e19-0697-424a-b59e-29685903af37 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:25.278859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13e19-0697-424a-b59e-29685903af37 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:25.279090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13e19-0697-424a-b59e-29685903af37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:25.299630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be0fa3-0925-4bfa-8ab6-b4f01da83da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:25.300427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be0fa3-0925-4bfa-8ab6-b4f01da83da5 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:25.300706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be0fa3-0925-4bfa-8ab6-b4f01da83da5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:25.300972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be0fa3-0925-4bfa-8ab6-b4f01da83da5 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:25.302266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be0fa3-0925-4bfa-8ab6-b4f01da83da5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:25.303712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be0fa3-0925-4bfa-8ab6-b4f01da83da5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:25.314245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-28f13e19-0697-424a-b59e-29685903af37 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:25.315457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-28f13e19-0697-424a-b59e-29685903af37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:25.343231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 234/476] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:39:25 2022] POST /identity/v3/users => generated 249 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:39:25.403846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 243/477] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:25.442125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be0fa3-0925-4bfa-8ab6-b4f01da83da5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:25.549197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be0fa3-0925-4bfa-8ab6-b4f01da83da5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:25.583222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2975af-3a74-45a5-a4ae-66dcbc8e2d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:25.583906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2975af-3a74-45a5-a4ae-66dcbc8e2d66 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:25.584181 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2975af-3a74-45a5-a4ae-66dcbc8e2d66 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:25.584450 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2975af-3a74-45a5-a4ae-66dcbc8e2d66 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:25.585220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2975af-3a74-45a5-a4ae-66dcbc8e2d66 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:25.586701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2975af-3a74-45a5-a4ae-66dcbc8e2d66 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:25.593132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.sql.core [None req-4e2975af-3a74-45a5-a4ae-66dcbc8e2d66 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 19:39:25.593132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 19:39:25.593132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [parameters: {'id': '97967342f9a345a48c7597f47c34141d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 19:39:25.593132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91691) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:39:25.608760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-4e2975af-3a74-45a5-a4ae-66dcbc8e2d66 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 19:39:25.610718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 235/478] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Oct 28 19:39:25 2022] POST /identity/v3/roles => generated 144 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:25.616610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13e19-0697-424a-b59e-29685903af37 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:25.753659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13e19-0697-424a-b59e-29685903af37 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:25.801914 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6116af8-1c2a-4c64-a4d0-2a9d01b52115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:25.802701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6116af8-1c2a-4c64-a4d0-2a9d01b52115 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:25.802989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6116af8-1c2a-4c64-a4d0-2a9d01b52115 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:25.803253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6116af8-1c2a-4c64-a4d0-2a9d01b52115 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:25.813882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6116af8-1c2a-4c64-a4d0-2a9d01b52115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:25.821481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-b6116af8-1c2a-4c64-a4d0-2a9d01b52115 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:39:25.823055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 244/479] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:39:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:25.828716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2975af-3a74-45a5-a4ae-66dcbc8e2d66 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:25.961037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2975af-3a74-45a5-a4ae-66dcbc8e2d66 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:26.007787 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5533c-26a2-4d2f-b75e-196d4129fb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:26.008476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5533c-26a2-4d2f-b75e-196d4129fb74 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:26.008762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5533c-26a2-4d2f-b75e-196d4129fb74 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:26.009041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5533c-26a2-4d2f-b75e-196d4129fb74 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:26.009803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5533c-26a2-4d2f-b75e-196d4129fb74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:26.010126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5533c-26a2-4d2f-b75e-196d4129fb74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:26.011535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5533c-26a2-4d2f-b75e-196d4129fb74 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:26.025577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 236/480] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:27.469485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba26aa-da11-4c62-b1a6-325f3edaba31 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:27.470568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba26aa-da11-4c62-b1a6-325f3edaba31 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:27.471053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba26aa-da11-4c62-b1a6-325f3edaba31 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:27.473501 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 245/481] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:27.479393 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130cec-7578-4a4d-8a99-cff9d0f18f44 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:27.480272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130cec-7578-4a4d-8a99-cff9d0f18f44 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:27.480747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130cec-7578-4a4d-8a99-cff9d0f18f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:27.506301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-6e130cec-7578-4a4d-8a99-cff9d0f18f44 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:27.507826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6e130cec-7578-4a4d-8a99-cff9d0f18f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:27.562100 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b53751-1c75-4ab0-8b2e-46cac12f100d None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:27.562788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b53751-1c75-4ab0-8b2e-46cac12f100d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:27.563262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b53751-1c75-4ab0-8b2e-46cac12f100d None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:27.565220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 246/482] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:27.570239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfda91e-55eb-4aee-bacc-558f651a6154 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:27.570797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfda91e-55eb-4aee-bacc-558f651a6154 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:27.571130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfda91e-55eb-4aee-bacc-558f651a6154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:27.599059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fbfda91e-55eb-4aee-bacc-558f651a6154 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:27.600261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fbfda91e-55eb-4aee-bacc-558f651a6154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:27.606747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 237/483] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:27.608310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fe298-70d6-4b51-8a3d-d39a9179937f None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:27.608803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fe298-70d6-4b51-8a3d-d39a9179937f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:27.609249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fe298-70d6-4b51-8a3d-d39a9179937f None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:27.611373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 238/484] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:27.620249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60ca6a-639a-499d-89f7-bb4bcc1b8c59 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:27.620904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60ca6a-639a-499d-89f7-bb4bcc1b8c59 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:27.621380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60ca6a-639a-499d-89f7-bb4bcc1b8c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:27.641566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-db60ca6a-639a-499d-89f7-bb4bcc1b8c59 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:27.650136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-db60ca6a-639a-499d-89f7-bb4bcc1b8c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:27.706603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 247/485] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:27.708008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfda91e-55eb-4aee-bacc-558f651a6154 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:27.716626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 239/486] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:27.739733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60ca6a-639a-499d-89f7-bb4bcc1b8c59 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:27.833512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfda91e-55eb-4aee-bacc-558f651a6154 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:27.857486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60ca6a-639a-499d-89f7-bb4bcc1b8c59 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:27.867061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fb68b-6eb2-47d8-a19c-cce5bcd0f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:27.868112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb68b-6eb2-47d8-a19c-cce5bcd0f1fe None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:27.868591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb68b-6eb2-47d8-a19c-cce5bcd0f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:27.869046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb68b-6eb2-47d8-a19c-cce5bcd0f1fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:27.886819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fb68b-6eb2-47d8-a19c-cce5bcd0f1fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:27.896850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-3f6fb68b-6eb2-47d8-a19c-cce5bcd0f1fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:27.903413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 248/487] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:27.903413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fb68b-6eb2-47d8-a19c-cce5bcd0f1fe None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:27.904662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7358-13d3-470c-904d-7886fd3b7c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:27.905735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7358-13d3-470c-904d-7886fd3b7c4e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:27.906313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7358-13d3-470c-904d-7886fd3b7c4e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:27.906777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7358-13d3-470c-904d-7886fd3b7c4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:27.919745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac7358-13d3-470c-904d-7886fd3b7c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:27.927784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-5dac7358-13d3-470c-904d-7886fd3b7c4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:27.929690 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 240/488] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:27.930690 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7358-13d3-470c-904d-7886fd3b7c4e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.010098 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fb68b-6eb2-47d8-a19c-cce5bcd0f1fe None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.043361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffb59b-81bc-44e1-b7d1-e0fcd7d44058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.044520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffb59b-81bc-44e1-b7d1-e0fcd7d44058 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.045007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffb59b-81bc-44e1-b7d1-e0fcd7d44058 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.045492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffb59b-81bc-44e1-b7d1-e0fcd7d44058 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.055688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7358-13d3-470c-904d-7886fd3b7c4e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.056590 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffb59b-81bc-44e1-b7d1-e0fcd7d44058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:28.063762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-5dffb59b-81bc-44e1-b7d1-e0fcd7d44058 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:28.065622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 249/489] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:28.066750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffb59b-81bc-44e1-b7d1-e0fcd7d44058 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.090403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175386b-e53b-46f7-b248-e7faeccda9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.091099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175386b-e53b-46f7-b248-e7faeccda9c2 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.091578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175386b-e53b-46f7-b248-e7faeccda9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.092071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175386b-e53b-46f7-b248-e7faeccda9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.093076 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175386b-e53b-46f7-b248-e7faeccda9c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:28.093552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175386b-e53b-46f7-b248-e7faeccda9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:28.095173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175386b-e53b-46f7-b248-e7faeccda9c2 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:28.104159 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 241/490] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:28.105262 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175386b-e53b-46f7-b248-e7faeccda9c2 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.168781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffb59b-81bc-44e1-b7d1-e0fcd7d44058 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.201649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127dc6-9ccb-475a-ba27-4ef8f5f819d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.202752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127dc6-9ccb-475a-ba27-4ef8f5f819d3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.203221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127dc6-9ccb-475a-ba27-4ef8f5f819d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.203684 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127dc6-9ccb-475a-ba27-4ef8f5f819d3 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.204645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127dc6-9ccb-475a-ba27-4ef8f5f819d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:28.205135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127dc6-9ccb-475a-ba27-4ef8f5f819d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:28.206793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127dc6-9ccb-475a-ba27-4ef8f5f819d3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:28.208362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175386b-e53b-46f7-b248-e7faeccda9c2 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.215602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 250/491] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:28.216861 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127dc6-9ccb-475a-ba27-4ef8f5f819d3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.247799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b48558-c1a9-40cc-b3d6-2a8a3488ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.248756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b48558-c1a9-40cc-b3d6-2a8a3488ff8b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.249183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b48558-c1a9-40cc-b3d6-2a8a3488ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.249599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b48558-c1a9-40cc-b3d6-2a8a3488ff8b None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.250646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b48558-c1a9-40cc-b3d6-2a8a3488ff8b None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:28.251159 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b48558-c1a9-40cc-b3d6-2a8a3488ff8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:28.252716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b48558-c1a9-40cc-b3d6-2a8a3488ff8b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:28.261529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 242/492] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:28.262676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b48558-c1a9-40cc-b3d6-2a8a3488ff8b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.316743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127dc6-9ccb-475a-ba27-4ef8f5f819d3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.349308 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa565df9-a05a-4920-bdd0-f90845779da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.350123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa565df9-a05a-4920-bdd0-f90845779da4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.350405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa565df9-a05a-4920-bdd0-f90845779da4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.350675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa565df9-a05a-4920-bdd0-f90845779da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.358794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b48558-c1a9-40cc-b3d6-2a8a3488ff8b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.361039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa565df9-a05a-4920-bdd0-f90845779da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:28.362602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa565df9-a05a-4920-bdd0-f90845779da4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:28.378520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-aa565df9-a05a-4920-bdd0-f90845779da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:28.384259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 251/493] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:28.384259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa565df9-a05a-4920-bdd0-f90845779da4 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.396466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7c4a6-2e09-4ee4-adb5-f11c6f80dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.397271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7c4a6-2e09-4ee4-adb5-f11c6f80dced None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.397551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7c4a6-2e09-4ee4-adb5-f11c6f80dced None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.397819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7c4a6-2e09-4ee4-adb5-f11c6f80dced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.408488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7c4a6-2e09-4ee4-adb5-f11c6f80dced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:28.410118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7c4a6-2e09-4ee4-adb5-f11c6f80dced None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:28.426863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-0af7c4a6-2e09-4ee4-adb5-f11c6f80dced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:28.428077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 243/494] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:28.429278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65de9-3958-456e-939c-7d7a36473ae2 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.429564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65de9-3958-456e-939c-7d7a36473ae2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.429833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65de9-3958-456e-939c-7d7a36473ae2 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.435651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 244/495] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:28.436437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea65de9-3958-456e-939c-7d7a36473ae2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.480755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa565df9-a05a-4920-bdd0-f90845779da4 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.512934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf778259-03e5-4b7b-9ec4-d85a62f8e800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.513663 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778259-03e5-4b7b-9ec4-d85a62f8e800 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.513950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778259-03e5-4b7b-9ec4-d85a62f8e800 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.514274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778259-03e5-4b7b-9ec4-d85a62f8e800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.524524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf778259-03e5-4b7b-9ec4-d85a62f8e800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:28.526009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf778259-03e5-4b7b-9ec4-d85a62f8e800 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:28.534792 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea65de9-3958-456e-939c-7d7a36473ae2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.542205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-bf778259-03e5-4b7b-9ec4-d85a62f8e800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:28.548322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 252/496] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:28.548322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf778259-03e5-4b7b-9ec4-d85a62f8e800 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.572286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808cb3d-493f-4c32-835e-86b2ad640178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.572937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808cb3d-493f-4c32-835e-86b2ad640178 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.573215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808cb3d-493f-4c32-835e-86b2ad640178 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.573486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808cb3d-493f-4c32-835e-86b2ad640178 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.574238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808cb3d-493f-4c32-835e-86b2ad640178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:28.574537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808cb3d-493f-4c32-835e-86b2ad640178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:28.575983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808cb3d-493f-4c32-835e-86b2ad640178 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:28.591689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 245/497] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:28.591689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d496-272f-42d8-87d3-b14d15554509 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.591689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d496-272f-42d8-87d3-b14d15554509 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.591689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d496-272f-42d8-87d3-b14d15554509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.607153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-88d6d496-272f-42d8-87d3-b14d15554509 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:28.608316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-88d6d496-272f-42d8-87d3-b14d15554509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:28.655120 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf778259-03e5-4b7b-9ec4-d85a62f8e800 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.678504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 246/498] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:28.679363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6d496-272f-42d8-87d3-b14d15554509 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.693091 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff130ef0-59c2-46b8-a25d-bb74e413e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.693752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130ef0-59c2-46b8-a25d-bb74e413e21d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.694026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130ef0-59c2-46b8-a25d-bb74e413e21d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.694328 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130ef0-59c2-46b8-a25d-bb74e413e21d None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.695051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff130ef0-59c2-46b8-a25d-bb74e413e21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:28.695350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff130ef0-59c2-46b8-a25d-bb74e413e21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:28.696779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff130ef0-59c2-46b8-a25d-bb74e413e21d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:28.713093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 253/499] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:28.714405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff130ef0-59c2-46b8-a25d-bb74e413e21d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.784474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6d496-272f-42d8-87d3-b14d15554509 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.812698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff130ef0-59c2-46b8-a25d-bb74e413e21d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.817229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d549e-7e47-4c08-90bd-604a9f0c0ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.817923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d549e-7e47-4c08-90bd-604a9f0c0ad0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.818247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d549e-7e47-4c08-90bd-604a9f0c0ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.818516 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d549e-7e47-4c08-90bd-604a9f0c0ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.819257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d549e-7e47-4c08-90bd-604a9f0c0ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:28.819559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d549e-7e47-4c08-90bd-604a9f0c0ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:28.821007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d549e-7e47-4c08-90bd-604a9f0c0ad0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:28.838626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 247/500] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:28.839399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d549e-7e47-4c08-90bd-604a9f0c0ad0 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.849442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120880b-0ced-40fc-b9c2-d355ff37ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.850290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120880b-0ced-40fc-b9c2-d355ff37ac3c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.850566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120880b-0ced-40fc-b9c2-d355ff37ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.850833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120880b-0ced-40fc-b9c2-d355ff37ac3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.858259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120880b-0ced-40fc-b9c2-d355ff37ac3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:28.859725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120880b-0ced-40fc-b9c2-d355ff37ac3c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:28.873409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c120880b-0ced-40fc-b9c2-d355ff37ac3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:39:28.874630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 254/501] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:28.875387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120880b-0ced-40fc-b9c2-d355ff37ac3c None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:28.943356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d549e-7e47-4c08-90bd-604a9f0c0ad0 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.970948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120880b-0ced-40fc-b9c2-d355ff37ac3c None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:28.975648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd499-da9e-4d11-a0a4-b41c00715e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:28.976459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd499-da9e-4d11-a0a4-b41c00715e16 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:28.976738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd499-da9e-4d11-a0a4-b41c00715e16 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:28.977012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd499-da9e-4d11-a0a4-b41c00715e16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:28.986962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fd499-da9e-4d11-a0a4-b41c00715e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:28.993956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-be8fd499-da9e-4d11-a0a4-b41c00715e16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:28.999823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 248/502] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:28.999823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd499-da9e-4d11-a0a4-b41c00715e16 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:29.008639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfa2d2-8685-4019-96ab-ba4baddf8894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:29.009440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfa2d2-8685-4019-96ab-ba4baddf8894 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.009720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfa2d2-8685-4019-96ab-ba4baddf8894 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.009993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfa2d2-8685-4019-96ab-ba4baddf8894 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.017000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfa2d2-8685-4019-96ab-ba4baddf8894 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:29.018487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfa2d2-8685-4019-96ab-ba4baddf8894 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:29.032277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c6cfa2d2-8685-4019-96ab-ba4baddf8894 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:39:29.038238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 255/503] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:29.038874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfa2d2-8685-4019-96ab-ba4baddf8894 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:29.095503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd499-da9e-4d11-a0a4-b41c00715e16 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:29.127179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b062060-ad45-4454-8c68-068489fca0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:29.127975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b062060-ad45-4454-8c68-068489fca0f7 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.128286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b062060-ad45-4454-8c68-068489fca0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.128554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b062060-ad45-4454-8c68-068489fca0f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.136013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b062060-ad45-4454-8c68-068489fca0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:29.137460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b062060-ad45-4454-8c68-068489fca0f7 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:29.141148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfa2d2-8685-4019-96ab-ba4baddf8894 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:29.151575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-4b062060-ad45-4454-8c68-068489fca0f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:39:29.157202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 249/504] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:29.157202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b062060-ad45-4454-8c68-068489fca0f7 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:29.175731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b21179-e830-4647-b739-b632f551c012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:29.176410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b21179-e830-4647-b739-b632f551c012 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.176690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b21179-e830-4647-b739-b632f551c012 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.176960 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b21179-e830-4647-b739-b632f551c012 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.177795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b21179-e830-4647-b739-b632f551c012 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:29.178134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b21179-e830-4647-b739-b632f551c012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:29.179579 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b21179-e830-4647-b739-b632f551c012 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:29.216121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 256/505] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Oct 28 19:39:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:29.216955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b21179-e830-4647-b739-b632f551c012 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:29.255463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b062060-ad45-4454-8c68-068489fca0f7 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:29.287070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd054f7-f76d-4741-a783-c246f27bf7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:29.287770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd054f7-f76d-4741-a783-c246f27bf7b8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.288047 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd054f7-f76d-4741-a783-c246f27bf7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.288376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd054f7-f76d-4741-a783-c246f27bf7b8 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.289101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd054f7-f76d-4741-a783-c246f27bf7b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:29.289400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd054f7-f76d-4741-a783-c246f27bf7b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:29.290812 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd054f7-f76d-4741-a783-c246f27bf7b8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:29.298779 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 250/506] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:29.299899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd054f7-f76d-4741-a783-c246f27bf7b8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:29.310612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b21179-e830-4647-b739-b632f551c012 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:29.343976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc7f0d-7c2e-49c3-8c1f-95a13229df47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:29.344645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc7f0d-7c2e-49c3-8c1f-95a13229df47 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.344928 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc7f0d-7c2e-49c3-8c1f-95a13229df47 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.345205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc7f0d-7c2e-49c3-8c1f-95a13229df47 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.346038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc7f0d-7c2e-49c3-8c1f-95a13229df47 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:29.346377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc7f0d-7c2e-49c3-8c1f-95a13229df47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:29.347922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc7f0d-7c2e-49c3-8c1f-95a13229df47 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:29.364201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 257/507] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Oct 28 19:39:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:29.365412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0cb1f-7de7-4237-bf55-44edb231316c None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.365668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0cb1f-7de7-4237-bf55-44edb231316c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.365946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0cb1f-7de7-4237-bf55-44edb231316c None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.367813 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 258/508] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:29.368313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0cb1f-7de7-4237-bf55-44edb231316c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:29.395752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd054f7-f76d-4741-a783-c246f27bf7b8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:29.427968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f735b-33bf-4c42-bc02-8ee27c558b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:29.428648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f735b-33bf-4c42-bc02-8ee27c558b5a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.428933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f735b-33bf-4c42-bc02-8ee27c558b5a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.429193 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f735b-33bf-4c42-bc02-8ee27c558b5a None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.430032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f735b-33bf-4c42-bc02-8ee27c558b5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:29.430360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f735b-33bf-4c42-bc02-8ee27c558b5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:29.431835 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f735b-33bf-4c42-bc02-8ee27c558b5a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:29.461755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0cb1f-7de7-4237-bf55-44edb231316c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:29.468090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 251/509] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Oct 28 19:39:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:29.468895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f735b-33bf-4c42-bc02-8ee27c558b5a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:29.495223 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495faca-b57d-46ad-9fc9-d290260f5f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:29.495866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495faca-b57d-46ad-9fc9-d290260f5f55 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.496145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495faca-b57d-46ad-9fc9-d290260f5f55 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.496419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495faca-b57d-46ad-9fc9-d290260f5f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.560445 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495faca-b57d-46ad-9fc9-d290260f5f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:29.561852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495faca-b57d-46ad-9fc9-d290260f5f55 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:29.562963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f735b-33bf-4c42-bc02-8ee27c558b5a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:29.596048 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa1c8a-8ca1-439f-ad9d-57c2b861dce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:29.596861 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1c8a-8ca1-439f-ad9d-57c2b861dce1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.597173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1c8a-8ca1-439f-ad9d-57c2b861dce1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.597449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1c8a-8ca1-439f-ad9d-57c2b861dce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.607133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa1c8a-8ca1-439f-ad9d-57c2b861dce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:29.608591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa1c8a-8ca1-439f-ad9d-57c2b861dce1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:29.624893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-39aa1c8a-8ca1-439f-ad9d-57c2b861dce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:29.626059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 252/510] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:29.626847 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa1c8a-8ca1-439f-ad9d-57c2b861dce1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:29.660067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 259/511] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:29.660067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8eaa-f863-45ba-89c7-1247a7db4cf8 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.660067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8eaa-f863-45ba-89c7-1247a7db4cf8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.660067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8eaa-f863-45ba-89c7-1247a7db4cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.673194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-407f8eaa-f863-45ba-89c7-1247a7db4cf8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:29.674431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-407f8eaa-f863-45ba-89c7-1247a7db4cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:29.726149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa1c8a-8ca1-439f-ad9d-57c2b861dce1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:29.737124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 260/512] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:29.738642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f8eaa-f863-45ba-89c7-1247a7db4cf8 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:29.759027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a144e8-dfb2-4fb4-a87e-8031c3a13e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:29.759677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a144e8-dfb2-4fb4-a87e-8031c3a13e49 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.759955 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a144e8-dfb2-4fb4-a87e-8031c3a13e49 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.760448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a144e8-dfb2-4fb4-a87e-8031c3a13e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.822621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a144e8-dfb2-4fb4-a87e-8031c3a13e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:29.824017 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a144e8-dfb2-4fb4-a87e-8031c3a13e49 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:29.832139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f8eaa-f863-45ba-89c7-1247a7db4cf8 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:29.864721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c463-bae4-41f3-92d8-dbffba972b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:29.865351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c463-bae4-41f3-92d8-dbffba972b8f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:29.865630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c463-bae4-41f3-92d8-dbffba972b8f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:29.865899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c463-bae4-41f3-92d8-dbffba972b8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:29.919306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 253/513] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:29.920201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a144e8-dfb2-4fb4-a87e-8031c3a13e49 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:29.931466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525c463-bae4-41f3-92d8-dbffba972b8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:29.932914 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525c463-bae4-41f3-92d8-dbffba972b8f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.015922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a144e8-dfb2-4fb4-a87e-8031c3a13e49 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.024995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 261/514] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:30.025779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c463-bae4-41f3-92d8-dbffba972b8f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.049343 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f41051-251b-4840-8bbe-73ae54a79c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.050435 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f41051-251b-4840-8bbe-73ae54a79c3d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.050709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f41051-251b-4840-8bbe-73ae54a79c3d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.050975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f41051-251b-4840-8bbe-73ae54a79c3d None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.051686 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f41051-251b-4840-8bbe-73ae54a79c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:30.052002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f41051-251b-4840-8bbe-73ae54a79c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.053364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f41051-251b-4840-8bbe-73ae54a79c3d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.064247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 254/515] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:30.065027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f41051-251b-4840-8bbe-73ae54a79c3d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.119208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c463-bae4-41f3-92d8-dbffba972b8f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.151240 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2825af-2cd2-4954-8029-7ccec08a67e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.152032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2825af-2cd2-4954-8029-7ccec08a67e5 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.152315 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2825af-2cd2-4954-8029-7ccec08a67e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.152585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2825af-2cd2-4954-8029-7ccec08a67e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.157762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f41051-251b-4840-8bbe-73ae54a79c3d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.162539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2825af-2cd2-4954-8029-7ccec08a67e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.164039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2825af-2cd2-4954-8029-7ccec08a67e5 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.181253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-cf2825af-2cd2-4954-8029-7ccec08a67e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:30.182452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 262/516] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:30.183222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2825af-2cd2-4954-8029-7ccec08a67e5 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.194577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b8e9a-b991-47c2-9a6f-9f6456da0067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.195381 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b8e9a-b991-47c2-9a6f-9f6456da0067 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.195661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b8e9a-b991-47c2-9a6f-9f6456da0067 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.195930 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b8e9a-b991-47c2-9a6f-9f6456da0067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.206263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b8e9a-b991-47c2-9a6f-9f6456da0067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.207720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b8e9a-b991-47c2-9a6f-9f6456da0067 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.225011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-588b8e9a-b991-47c2-9a6f-9f6456da0067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:30.226371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 255/517] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:30.227000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b8e9a-b991-47c2-9a6f-9f6456da0067 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.281160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2825af-2cd2-4954-8029-7ccec08a67e5 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.314532 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295722b0-0fff-4cd5-aaa5-4958b932938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.315339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295722b0-0fff-4cd5-aaa5-4958b932938a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.315622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295722b0-0fff-4cd5-aaa5-4958b932938a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.315918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295722b0-0fff-4cd5-aaa5-4958b932938a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.326774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295722b0-0fff-4cd5-aaa5-4958b932938a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.328254 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295722b0-0fff-4cd5-aaa5-4958b932938a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.328453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b8e9a-b991-47c2-9a6f-9f6456da0067 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.344692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-295722b0-0fff-4cd5-aaa5-4958b932938a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:30.345873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 263/518] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:30.350644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295722b0-0fff-4cd5-aaa5-4958b932938a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.360617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541352cc-f998-4fcc-a300-44abb3fbd523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.361414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541352cc-f998-4fcc-a300-44abb3fbd523 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.361699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541352cc-f998-4fcc-a300-44abb3fbd523 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.361968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541352cc-f998-4fcc-a300-44abb3fbd523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.372603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541352cc-f998-4fcc-a300-44abb3fbd523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.374012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541352cc-f998-4fcc-a300-44abb3fbd523 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.390145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-541352cc-f998-4fcc-a300-44abb3fbd523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:30.391338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 256/519] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:30.392084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541352cc-f998-4fcc-a300-44abb3fbd523 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.441400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295722b0-0fff-4cd5-aaa5-4958b932938a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.474288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853bf21-ddf6-4caf-80e6-3fde75b31f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.475078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853bf21-ddf6-4caf-80e6-3fde75b31f7f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.475362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853bf21-ddf6-4caf-80e6-3fde75b31f7f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.475637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853bf21-ddf6-4caf-80e6-3fde75b31f7f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.482969 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853bf21-ddf6-4caf-80e6-3fde75b31f7f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.484430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853bf21-ddf6-4caf-80e6-3fde75b31f7f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.486861 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541352cc-f998-4fcc-a300-44abb3fbd523 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.497742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-f853bf21-ddf6-4caf-80e6-3fde75b31f7f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:39:30.498971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 264/520] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:30.499728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853bf21-ddf6-4caf-80e6-3fde75b31f7f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.521334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c99b3c-ae6d-4ddc-bacc-5bad8e385e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.522125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99b3c-ae6d-4ddc-bacc-5bad8e385e52 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.522405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99b3c-ae6d-4ddc-bacc-5bad8e385e52 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.522676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99b3c-ae6d-4ddc-bacc-5bad8e385e52 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.523382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c99b3c-ae6d-4ddc-bacc-5bad8e385e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:30.523679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c99b3c-ae6d-4ddc-bacc-5bad8e385e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.525042 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c99b3c-ae6d-4ddc-bacc-5bad8e385e52 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.535762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 257/521] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:30.536526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c99b3c-ae6d-4ddc-bacc-5bad8e385e52 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.592954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853bf21-ddf6-4caf-80e6-3fde75b31f7f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.627231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b894da-3e95-445f-a777-ad3ceb09bf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.627821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b894da-3e95-445f-a777-ad3ceb09bf92 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.628093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b894da-3e95-445f-a777-ad3ceb09bf92 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.628389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b894da-3e95-445f-a777-ad3ceb09bf92 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.629119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b894da-3e95-445f-a777-ad3ceb09bf92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:30.629409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b894da-3e95-445f-a777-ad3ceb09bf92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.630811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b894da-3e95-445f-a777-ad3ceb09bf92 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.634525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c99b3c-ae6d-4ddc-bacc-5bad8e385e52 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.643044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 265/522] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:30.643417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b894da-3e95-445f-a777-ad3ceb09bf92 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.667527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b283e27-e7f1-4038-af11-55cd217aae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.668194 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b283e27-e7f1-4038-af11-55cd217aae59 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.668474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b283e27-e7f1-4038-af11-55cd217aae59 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.668751 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b283e27-e7f1-4038-af11-55cd217aae59 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.669447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b283e27-e7f1-4038-af11-55cd217aae59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:30.669748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b283e27-e7f1-4038-af11-55cd217aae59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.671176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b283e27-e7f1-4038-af11-55cd217aae59 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.682950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 258/523] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:30.683806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b283e27-e7f1-4038-af11-55cd217aae59 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.738012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b894da-3e95-445f-a777-ad3ceb09bf92 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.769551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92a6ed-68a1-4510-9ab9-759fd35eff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.770251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92a6ed-68a1-4510-9ab9-759fd35eff57 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.770531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92a6ed-68a1-4510-9ab9-759fd35eff57 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.770801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92a6ed-68a1-4510-9ab9-759fd35eff57 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.771524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92a6ed-68a1-4510-9ab9-759fd35eff57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:30.771825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92a6ed-68a1-4510-9ab9-759fd35eff57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.773216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92a6ed-68a1-4510-9ab9-759fd35eff57 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.775929 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b283e27-e7f1-4038-af11-55cd217aae59 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.784260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 266/524] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:30.785170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92a6ed-68a1-4510-9ab9-759fd35eff57 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.808339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54344c-91e0-4d95-aff9-44d67ec95f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.809012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54344c-91e0-4d95-aff9-44d67ec95f9a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.809289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54344c-91e0-4d95-aff9-44d67ec95f9a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.809563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54344c-91e0-4d95-aff9-44d67ec95f9a None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.810407 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54344c-91e0-4d95-aff9-44d67ec95f9a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:30.810714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54344c-91e0-4d95-aff9-44d67ec95f9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.812147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54344c-91e0-4d95-aff9-44d67ec95f9a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.828468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 259/525] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:30.829238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54344c-91e0-4d95-aff9-44d67ec95f9a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.881643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92a6ed-68a1-4510-9ab9-759fd35eff57 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.913532 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2601fbb-b536-4b2a-bab3-48d675f0b2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.914446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2601fbb-b536-4b2a-bab3-48d675f0b2a8 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.914724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2601fbb-b536-4b2a-bab3-48d675f0b2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.915013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2601fbb-b536-4b2a-bab3-48d675f0b2a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.922507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2601fbb-b536-4b2a-bab3-48d675f0b2a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.923979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2601fbb-b536-4b2a-bab3-48d675f0b2a8 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.924111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54344c-91e0-4d95-aff9-44d67ec95f9a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:30.938393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c2601fbb-b536-4b2a-bab3-48d675f0b2a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:30.939566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 267/526] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:30.940332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2601fbb-b536-4b2a-bab3-48d675f0b2a8 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:30.957270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c1b73-8698-431d-934d-1943b5d9307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:30.957944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c1b73-8698-431d-934d-1943b5d9307b None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:30.958260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c1b73-8698-431d-934d-1943b5d9307b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:30.958555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c1b73-8698-431d-934d-1943b5d9307b None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:30.959257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c1b73-8698-431d-934d-1943b5d9307b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:30.960701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c1b73-8698-431d-934d-1943b5d9307b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:30.981156 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 260/527] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:39:30 2022] POST /identity/v3/users => generated 247 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:39:30.981975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c1b73-8698-431d-934d-1943b5d9307b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:31.040137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2601fbb-b536-4b2a-bab3-48d675f0b2a8 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.075806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292e093-7d1b-4161-b1ff-e5c90e9e4737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.076611 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292e093-7d1b-4161-b1ff-e5c90e9e4737 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.076892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292e093-7d1b-4161-b1ff-e5c90e9e4737 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.077163 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292e093-7d1b-4161-b1ff-e5c90e9e4737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.084784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292e093-7d1b-4161-b1ff-e5c90e9e4737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.086505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c1b73-8698-431d-934d-1943b5d9307b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.086642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292e093-7d1b-4161-b1ff-e5c90e9e4737 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.100524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-8292e093-7d1b-4161-b1ff-e5c90e9e4737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:31.101939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 268/528] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:31.102670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292e093-7d1b-4161-b1ff-e5c90e9e4737 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:31.122567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246d1b6-1e2e-455b-bc0a-92fe12367b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.123409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246d1b6-1e2e-455b-bc0a-92fe12367b41 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.123684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246d1b6-1e2e-455b-bc0a-92fe12367b41 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.123958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246d1b6-1e2e-455b-bc0a-92fe12367b41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.131605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246d1b6-1e2e-455b-bc0a-92fe12367b41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.133317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246d1b6-1e2e-455b-bc0a-92fe12367b41 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.147897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-f246d1b6-1e2e-455b-bc0a-92fe12367b41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:31.149168 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 261/529] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:31.150030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246d1b6-1e2e-455b-bc0a-92fe12367b41 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:31.205568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292e093-7d1b-4161-b1ff-e5c90e9e4737 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.238540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c82ab5-c113-49d4-825f-0065037abb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.239204 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c82ab5-c113-49d4-825f-0065037abb27 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.239487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c82ab5-c113-49d4-825f-0065037abb27 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.239761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c82ab5-c113-49d4-825f-0065037abb27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.250506 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246d1b6-1e2e-455b-bc0a-92fe12367b41 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.282701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f263831-5089-4646-8589-017224ac8994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.283421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f263831-5089-4646-8589-017224ac8994 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.283694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f263831-5089-4646-8589-017224ac8994 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.283971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f263831-5089-4646-8589-017224ac8994 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.284984 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f263831-5089-4646-8589-017224ac8994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:31.285281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f263831-5089-4646-8589-017224ac8994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.286831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f263831-5089-4646-8589-017224ac8994 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.304786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 262/530] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:31.305196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c82ab5-c113-49d4-825f-0065037abb27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.305712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f263831-5089-4646-8589-017224ac8994 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:31.307240 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c82ab5-c113-49d4-825f-0065037abb27 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.403926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 269/531] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:31.404545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c82ab5-c113-49d4-825f-0065037abb27 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:31.407500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f263831-5089-4646-8589-017224ac8994 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.443943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd391e-46b1-45eb-939a-3e1af817a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.444761 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd391e-46b1-45eb-939a-3e1af817a7ad None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.445136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd391e-46b1-45eb-939a-3e1af817a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.445509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd391e-46b1-45eb-939a-3e1af817a7ad None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.446450 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd391e-46b1-45eb-939a-3e1af817a7ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:31.447057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd391e-46b1-45eb-939a-3e1af817a7ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.448446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd391e-46b1-45eb-939a-3e1af817a7ad None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.465240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 263/532] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:31.466202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd391e-46b1-45eb-939a-3e1af817a7ad None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:31.499783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c82ab5-c113-49d4-825f-0065037abb27 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.531631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282fb00-ef4d-4f7c-8f39-089b50700c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.532378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282fb00-ef4d-4f7c-8f39-089b50700c08 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.532728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282fb00-ef4d-4f7c-8f39-089b50700c08 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.533069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282fb00-ef4d-4f7c-8f39-089b50700c08 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.533945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282fb00-ef4d-4f7c-8f39-089b50700c08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:31.534313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282fb00-ef4d-4f7c-8f39-089b50700c08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.535820 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282fb00-ef4d-4f7c-8f39-089b50700c08 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.553216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 270/533] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:31.554426 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282fb00-ef4d-4f7c-8f39-089b50700c08 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:31.560149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd391e-46b1-45eb-939a-3e1af817a7ad None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.592095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bb558-b65a-4932-82a9-778a2360959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.592756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb558-b65a-4932-82a9-778a2360959d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.593029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb558-b65a-4932-82a9-778a2360959d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.593304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb558-b65a-4932-82a9-778a2360959d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.594151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bb558-b65a-4932-82a9-778a2360959d None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=be7be85d70b64273b7904082ee2ba848) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:31.594463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bb558-b65a-4932-82a9-778a2360959d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.595898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bb558-b65a-4932-82a9-778a2360959d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.601345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 264/534] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:31 2022] GET /identity/v3/role_assignments?user.id=be7be85d70b64273b7904082ee2ba848&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:31.602115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bb558-b65a-4932-82a9-778a2360959d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:31.667296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282fb00-ef4d-4f7c-8f39-089b50700c08 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.704766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ea18-43d6-41f5-bc7f-87bca3dd1995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.706181 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ea18-43d6-41f5-bc7f-87bca3dd1995 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.706828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ea18-43d6-41f5-bc7f-87bca3dd1995 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.707255 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ea18-43d6-41f5-bc7f-87bca3dd1995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.713771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bb558-b65a-4932-82a9-778a2360959d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.722503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47ea18-43d6-41f5-bc7f-87bca3dd1995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.724859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47ea18-43d6-41f5-bc7f-87bca3dd1995 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.748128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-3c47ea18-43d6-41f5-bc7f-87bca3dd1995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:31.754226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dd6fc-16dc-4a11-943e-35016d60a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.754226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dd6fc-16dc-4a11-943e-35016d60a87b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.754226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dd6fc-16dc-4a11-943e-35016d60a87b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.754226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dd6fc-16dc-4a11-943e-35016d60a87b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.754700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57dd6fc-16dc-4a11-943e-35016d60a87b None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=ba2e2211f5d14ebcbd0221278248b868) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:31.754700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57dd6fc-16dc-4a11-943e-35016d60a87b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.754700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57dd6fc-16dc-4a11-943e-35016d60a87b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.755408 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 271/535] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:31.756776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ea18-43d6-41f5-bc7f-87bca3dd1995 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:31.766455 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 265/536] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:31 2022] GET /identity/v3/role_assignments?user.id=ba2e2211f5d14ebcbd0221278248b868&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:31.767499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dd6fc-16dc-4a11-943e-35016d60a87b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:31.890432 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ea18-43d6-41f5-bc7f-87bca3dd1995 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.899715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dd6fc-16dc-4a11-943e-35016d60a87b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:31.934135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d103c4-0f78-4380-a9a0-acbc7877b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.934351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03190767-27bd-4594-942f-98a2efd2f0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:31.935062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03190767-27bd-4594-942f-98a2efd2f0e4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.935326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d103c4-0f78-4380-a9a0-acbc7877b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:31.935439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03190767-27bd-4594-942f-98a2efd2f0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.935671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03190767-27bd-4594-942f-98a2efd2f0e4 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.935972 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d103c4-0f78-4380-a9a0-acbc7877b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:31.936378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d103c4-0f78-4380-a9a0-acbc7877b4a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:31.936496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03190767-27bd-4594-942f-98a2efd2f0e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:31.936701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03190767-27bd-4594-942f-98a2efd2f0e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.937622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d103c4-0f78-4380-a9a0-acbc7877b4a0 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=f94515985e244af29f47a49c0dd415ec) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:31.938109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d103c4-0f78-4380-a9a0-acbc7877b4a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:31.938229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03190767-27bd-4594-942f-98a2efd2f0e4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.940117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d103c4-0f78-4380-a9a0-acbc7877b4a0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:31.947487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 272/537] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:31 2022] GET /identity/v3/role_assignments?user.id=f94515985e244af29f47a49c0dd415ec&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:31.960362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 266/538] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:31.966347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d103c4-0f78-4380-a9a0-acbc7877b4a0 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:32.085112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d103c4-0f78-4380-a9a0-acbc7877b4a0 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:32.123313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944fba-a19e-49c2-a5b1-27101c2b4204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:32.124391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944fba-a19e-49c2-a5b1-27101c2b4204 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:32.124848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944fba-a19e-49c2-a5b1-27101c2b4204 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:32.125260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944fba-a19e-49c2-a5b1-27101c2b4204 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:32.133199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944fba-a19e-49c2-a5b1-27101c2b4204 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:32.135031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944fba-a19e-49c2-a5b1-27101c2b4204 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:32.149556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-e5944fba-a19e-49c2-a5b1-27101c2b4204 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:32.151578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 273/539] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:32.157090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03190767-27bd-4594-942f-98a2efd2f0e4 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:32.303671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03190767-27bd-4594-942f-98a2efd2f0e4 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:32.341483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ee30d-2f70-4e09-a9db-e6060380b6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:32.342186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ee30d-2f70-4e09-a9db-e6060380b6eb None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:32.342468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ee30d-2f70-4e09-a9db-e6060380b6eb None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:32.342739 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ee30d-2f70-4e09-a9db-e6060380b6eb None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:32.343524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ee30d-2f70-4e09-a9db-e6060380b6eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:32.343827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ee30d-2f70-4e09-a9db-e6060380b6eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:32.345264 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ee30d-2f70-4e09-a9db-e6060380b6eb None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:32.356959 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 267/540] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:32.362988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944fba-a19e-49c2-a5b1-27101c2b4204 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:32.495843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944fba-a19e-49c2-a5b1-27101c2b4204 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:32.537034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283b059-08a7-4f7c-a009-da187b01a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:32.537697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283b059-08a7-4f7c-a009-da187b01a657 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:32.537981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283b059-08a7-4f7c-a009-da187b01a657 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:32.538287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283b059-08a7-4f7c-a009-da187b01a657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:32.539123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283b059-08a7-4f7c-a009-da187b01a657 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=444a88451fbd4814b6d81023e68b54a7) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:32.539501 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283b059-08a7-4f7c-a009-da187b01a657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:32.540963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283b059-08a7-4f7c-a009-da187b01a657 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:32.549586 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 274/541] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:32 2022] GET /identity/v3/role_assignments?user.id=444a88451fbd4814b6d81023e68b54a7&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:33.738926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c50ea3-de45-40c3-9bc7-53299e1a9714 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:33.739449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c50ea3-de45-40c3-9bc7-53299e1a9714 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:33.739449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c50ea3-de45-40c3-9bc7-53299e1a9714 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:33.741548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 268/542] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:33.746722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502a669-caf4-4453-b440-34f34d8842bd None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:33.747572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502a669-caf4-4453-b440-34f34d8842bd None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:33.748063 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502a669-caf4-4453-b440-34f34d8842bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:33.765705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0502a669-caf4-4453-b440-34f34d8842bd None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:33.767335 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0502a669-caf4-4453-b440-34f34d8842bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:33.835412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 275/543] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:33.859173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c50ea3-de45-40c3-9bc7-53299e1a9714 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:33.964677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c50ea3-de45-40c3-9bc7-53299e1a9714 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:33.999795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73aff59-ad58-41a6-96f5-cd4b3dae505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:34.001004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aff59-ad58-41a6-96f5-cd4b3dae505b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:34.001491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aff59-ad58-41a6-96f5-cd4b3dae505b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:34.001999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aff59-ad58-41a6-96f5-cd4b3dae505b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:34.012799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73aff59-ad58-41a6-96f5-cd4b3dae505b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:34.020262 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a73aff59-ad58-41a6-96f5-cd4b3dae505b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:34.022017 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 269/544] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:34.028197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502a669-caf4-4453-b440-34f34d8842bd None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:34.129361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502a669-caf4-4453-b440-34f34d8842bd None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:34.164354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b9f26-5bd3-4114-985f-ccc86f46a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:34.165403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b9f26-5bd3-4114-985f-ccc86f46a5c4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:34.165896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b9f26-5bd3-4114-985f-ccc86f46a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:34.166338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b9f26-5bd3-4114-985f-ccc86f46a5c4 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:34.167261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b9f26-5bd3-4114-985f-ccc86f46a5c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:34.167714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b9f26-5bd3-4114-985f-ccc86f46a5c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:34.169363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b9f26-5bd3-4114-985f-ccc86f46a5c4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:34.178694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 276/545] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:34.186612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73aff59-ad58-41a6-96f5-cd4b3dae505b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:34.325573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73aff59-ad58-41a6-96f5-cd4b3dae505b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:34.374760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99cbca-14b3-4fc9-96d7-c3efea9011ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:34.375565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99cbca-14b3-4fc9-96d7-c3efea9011ee None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:34.375841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99cbca-14b3-4fc9-96d7-c3efea9011ee None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:34.377694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99cbca-14b3-4fc9-96d7-c3efea9011ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:34.391665 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99cbca-14b3-4fc9-96d7-c3efea9011ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:34.393129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99cbca-14b3-4fc9-96d7-c3efea9011ee None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:34.412306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-cc99cbca-14b3-4fc9-96d7-c3efea9011ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:34.414835 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 270/546] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:34.419910 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b9f26-5bd3-4114-985f-ccc86f46a5c4 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:34.551678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b9f26-5bd3-4114-985f-ccc86f46a5c4 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:34.586306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874dea-75b6-4b8b-96c1-d229857735a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:34.587386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874dea-75b6-4b8b-96c1-d229857735a8 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:34.587862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874dea-75b6-4b8b-96c1-d229857735a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:34.588326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874dea-75b6-4b8b-96c1-d229857735a8 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:34.589265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874dea-75b6-4b8b-96c1-d229857735a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:34.589768 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874dea-75b6-4b8b-96c1-d229857735a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:34.591518 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874dea-75b6-4b8b-96c1-d229857735a8 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:34.596558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908baacd-49d3-4c63-a9e4-0df92a064300 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:34.596843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908baacd-49d3-4c63-a9e4-0df92a064300 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:34.597119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908baacd-49d3-4c63-a9e4-0df92a064300 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:34.599061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 271/547] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:39:34.605709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 277/548] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:34.614163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499067-80b1-491e-b0bf-acb41ca33145 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:34.614163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499067-80b1-491e-b0bf-acb41ca33145 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:34.614163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499067-80b1-491e-b0bf-acb41ca33145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:34.615580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874dea-75b6-4b8b-96c1-d229857735a8 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:34.639656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e1499067-80b1-491e-b0bf-acb41ca33145 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:34.640887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e1499067-80b1-491e-b0bf-acb41ca33145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:34.761376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 272/549] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:34.769914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571531d-a630-48d9-9772-c34cd085a9dc None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:34.770310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571531d-a630-48d9-9772-c34cd085a9dc None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:34.770595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571531d-a630-48d9-9772-c34cd085a9dc None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:34.771225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874dea-75b6-4b8b-96c1-d229857735a8 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:34.772783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 273/550] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:34.778237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8889f8-df50-49b9-b669-0abdbd14cf49 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:34.778603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8889f8-df50-49b9-b669-0abdbd14cf49 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:34.778881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8889f8-df50-49b9-b669-0abdbd14cf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:34.803065 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-dc8889f8-df50-49b9-b669-0abdbd14cf49 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:34.804249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-dc8889f8-df50-49b9-b669-0abdbd14cf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:34.809328 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d538546-2390-44b6-9bd8-52c12b033600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:34.810477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d538546-2390-44b6-9bd8-52c12b033600 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:34.810957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d538546-2390-44b6-9bd8-52c12b033600 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:34.811457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d538546-2390-44b6-9bd8-52c12b033600 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:34.819930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d538546-2390-44b6-9bd8-52c12b033600 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:34.821760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d538546-2390-44b6-9bd8-52c12b033600 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:34.836592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-9d538546-2390-44b6-9bd8-52c12b033600 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:39:34.838545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 278/551] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:34.839596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d538546-2390-44b6-9bd8-52c12b033600 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:34.872170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 274/552] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:34.873047 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8889f8-df50-49b9-b669-0abdbd14cf49 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:34.940080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d538546-2390-44b6-9bd8-52c12b033600 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:34.970069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8889f8-df50-49b9-b669-0abdbd14cf49 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:34.975361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aa1e4-c5ac-4697-8d6a-c3c321e04aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:34.976583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aa1e4-c5ac-4697-8d6a-c3c321e04aa7 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:34.977087 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aa1e4-c5ac-4697-8d6a-c3c321e04aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:34.977566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aa1e4-c5ac-4697-8d6a-c3c321e04aa7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:34.990452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19aa1e4-c5ac-4697-8d6a-c3c321e04aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:34.998445 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-b19aa1e4-c5ac-4697-8d6a-c3c321e04aa7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:35.000390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 279/553] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:35.001421 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aa1e4-c5ac-4697-8d6a-c3c321e04aa7 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.007791 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04b1c6-7bfd-4852-af05-98c3fae34679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.008486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04b1c6-7bfd-4852-af05-98c3fae34679 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.008769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04b1c6-7bfd-4852-af05-98c3fae34679 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.009045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04b1c6-7bfd-4852-af05-98c3fae34679 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.009900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04b1c6-7bfd-4852-af05-98c3fae34679 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:35.010263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04b1c6-7bfd-4852-af05-98c3fae34679 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:35.011745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04b1c6-7bfd-4852-af05-98c3fae34679 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:35.029797 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 275/554] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Oct 28 19:39:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:35.030702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04b1c6-7bfd-4852-af05-98c3fae34679 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.104828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aa1e4-c5ac-4697-8d6a-c3c321e04aa7 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:35.127006 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04b1c6-7bfd-4852-af05-98c3fae34679 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:35.140551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0bde4-3e55-48c6-a74f-4bf1848ae89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.141356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0bde4-3e55-48c6-a74f-4bf1848ae89e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.141642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0bde4-3e55-48c6-a74f-4bf1848ae89e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.141896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0bde4-3e55-48c6-a74f-4bf1848ae89e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.151791 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0bde4-3e55-48c6-a74f-4bf1848ae89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:35.159107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-fda0bde4-3e55-48c6-a74f-4bf1848ae89e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:35.159214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcde318-8dae-4afe-8045-5a97903cf825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.159900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde318-8dae-4afe-8045-5a97903cf825 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.160184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde318-8dae-4afe-8045-5a97903cf825 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.160458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde318-8dae-4afe-8045-5a97903cf825 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.161203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcde318-8dae-4afe-8045-5a97903cf825 None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:35.161508 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcde318-8dae-4afe-8045-5a97903cf825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:35.162924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcde318-8dae-4afe-8045-5a97903cf825 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:35.165390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 280/555] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:35.166273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0bde4-3e55-48c6-a74f-4bf1848ae89e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.175982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 276/556] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:35.175982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c517f1-8af7-417c-83ad-d83cc7e76f1e None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.175982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c517f1-8af7-417c-83ad-d83cc7e76f1e None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.175982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c517f1-8af7-417c-83ad-d83cc7e76f1e None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.175982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 277/557] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:35.175982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c517f1-8af7-417c-83ad-d83cc7e76f1e None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.269144 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0bde4-3e55-48c6-a74f-4bf1848ae89e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:35.281786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c517f1-8af7-417c-83ad-d83cc7e76f1e None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:35.304160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7baf3a-6541-4205-b5ed-5a34f030a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.304977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7baf3a-6541-4205-b5ed-5a34f030a76e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.305571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7baf3a-6541-4205-b5ed-5a34f030a76e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.305904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7baf3a-6541-4205-b5ed-5a34f030a76e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.315612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc2fc6-664e-4894-9d93-e6c1f1b895ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.316346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc2fc6-664e-4894-9d93-e6c1f1b895ad None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.316630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc2fc6-664e-4894-9d93-e6c1f1b895ad None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.317101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc2fc6-664e-4894-9d93-e6c1f1b895ad None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.317654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc2fc6-664e-4894-9d93-e6c1f1b895ad None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:35.317975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc2fc6-664e-4894-9d93-e6c1f1b895ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:35.319401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc2fc6-664e-4894-9d93-e6c1f1b895ad None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:35.332554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 278/558] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:35.332554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc2fc6-664e-4894-9d93-e6c1f1b895ad None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.374801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7baf3a-6541-4205-b5ed-5a34f030a76e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:35.376205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7baf3a-6541-4205-b5ed-5a34f030a76e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:35.423708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc2fc6-664e-4894-9d93-e6c1f1b895ad None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:35.457125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36857e1-6295-4812-bd33-2a53a65b1623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.457911 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36857e1-6295-4812-bd33-2a53a65b1623 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.458223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36857e1-6295-4812-bd33-2a53a65b1623 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.458499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36857e1-6295-4812-bd33-2a53a65b1623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.468670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36857e1-6295-4812-bd33-2a53a65b1623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:35.470154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36857e1-6295-4812-bd33-2a53a65b1623 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:35.471200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 281/559] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:35.472611 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c46ef-1911-4d41-9cb8-be4156eb9f38 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.472894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c46ef-1911-4d41-9cb8-be4156eb9f38 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.473162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c46ef-1911-4d41-9cb8-be4156eb9f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.486262 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-f36857e1-6295-4812-bd33-2a53a65b1623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:35.487485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 279/560] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:35.488282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36857e1-6295-4812-bd33-2a53a65b1623 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.492076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-437c46ef-1911-4d41-9cb8-be4156eb9f38 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:35.493246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-437c46ef-1911-4d41-9cb8-be4156eb9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:35.555643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 282/561] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:35.556979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb30f6-92d9-481e-b04c-7a1d40a48384 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.557264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb30f6-92d9-481e-b04c-7a1d40a48384 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.557531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb30f6-92d9-481e-b04c-7a1d40a48384 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.559212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 283/562] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:35.559889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb30f6-92d9-481e-b04c-7a1d40a48384 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.586835 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36857e1-6295-4812-bd33-2a53a65b1623 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:35.618069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1230105-bf7a-4d95-9509-e6891c78cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.618906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230105-bf7a-4d95-9509-e6891c78cd69 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.619183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230105-bf7a-4d95-9509-e6891c78cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.619455 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230105-bf7a-4d95-9509-e6891c78cd69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.629822 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1230105-bf7a-4d95-9509-e6891c78cd69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:35.631237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1230105-bf7a-4d95-9509-e6891c78cd69 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:35.647239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-b1230105-bf7a-4d95-9509-e6891c78cd69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:35.648434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 280/563] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:35.649190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1230105-bf7a-4d95-9509-e6891c78cd69 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.660485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb30f6-92d9-481e-b04c-7a1d40a48384 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:35.692869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7a402-41be-46b7-96ed-70eb7cf653ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.693660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a402-41be-46b7-96ed-70eb7cf653ff None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.693931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a402-41be-46b7-96ed-70eb7cf653ff None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.694251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a402-41be-46b7-96ed-70eb7cf653ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.704175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7a402-41be-46b7-96ed-70eb7cf653ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:35.705635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7a402-41be-46b7-96ed-70eb7cf653ff None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:35.722762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-42e7a402-41be-46b7-96ed-70eb7cf653ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:35.723947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 284/564] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:35.725164 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b80d-1e5c-4b80-900c-6c5f09c75031 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.725441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b80d-1e5c-4b80-900c-6c5f09c75031 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.725710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b80d-1e5c-4b80-900c-6c5f09c75031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.741885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0777b80d-1e5c-4b80-900c-6c5f09c75031 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:35.743067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0777b80d-1e5c-4b80-900c-6c5f09c75031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:35.748265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1230105-bf7a-4d95-9509-e6891c78cd69 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:35.781320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cfca5-f89b-4e25-a8a4-ce1397e33a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.781949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cfca5-f89b-4e25-a8a4-ce1397e33a18 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.782276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cfca5-f89b-4e25-a8a4-ce1397e33a18 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.782546 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cfca5-f89b-4e25-a8a4-ce1397e33a18 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.783265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cfca5-f89b-4e25-a8a4-ce1397e33a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:35.783564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cfca5-f89b-4e25-a8a4-ce1397e33a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:35.784981 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cfca5-f89b-4e25-a8a4-ce1397e33a18 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:35.796738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 281/565] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:35.797341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cfca5-f89b-4e25-a8a4-ce1397e33a18 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.807076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 285/566] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:35.807957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b80d-1e5c-4b80-900c-6c5f09c75031 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.891911 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cfca5-f89b-4e25-a8a4-ce1397e33a18 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:35.912464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b80d-1e5c-4b80-900c-6c5f09c75031 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:35.924359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea59bb-1db6-40fa-a519-8b6c1029486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.925722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea59bb-1db6-40fa-a519-8b6c1029486d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.925995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea59bb-1db6-40fa-a519-8b6c1029486d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.926290 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea59bb-1db6-40fa-a519-8b6c1029486d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.936071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea59bb-1db6-40fa-a519-8b6c1029486d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:35.942999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-17ea59bb-1db6-40fa-a519-8b6c1029486d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:35.944327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 282/567] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:35.944993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea59bb-1db6-40fa-a519-8b6c1029486d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:35.945985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ca79b-ebfc-42e1-92e4-206af99a680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:35.946676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ca79b-ebfc-42e1-92e4-206af99a680b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:35.946954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ca79b-ebfc-42e1-92e4-206af99a680b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:35.947220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ca79b-ebfc-42e1-92e4-206af99a680b None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:35.947940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ca79b-ebfc-42e1-92e4-206af99a680b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:35.948240 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ca79b-ebfc-42e1-92e4-206af99a680b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:35.949628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ca79b-ebfc-42e1-92e4-206af99a680b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:35.960971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 286/568] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:35.961618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ca79b-ebfc-42e1-92e4-206af99a680b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.040978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea59bb-1db6-40fa-a519-8b6c1029486d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.053722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ca79b-ebfc-42e1-92e4-206af99a680b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.075431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757eb42-dc9b-40c4-aae9-afe3f1d7fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.076119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757eb42-dc9b-40c4-aae9-afe3f1d7fd18 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.076378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757eb42-dc9b-40c4-aae9-afe3f1d7fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.076651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757eb42-dc9b-40c4-aae9-afe3f1d7fd18 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.077370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757eb42-dc9b-40c4-aae9-afe3f1d7fd18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:36.077673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757eb42-dc9b-40c4-aae9-afe3f1d7fd18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.079054 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757eb42-dc9b-40c4-aae9-afe3f1d7fd18 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.085267 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516a604-c115-4816-a91c-88155d8b8110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.086056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516a604-c115-4816-a91c-88155d8b8110 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.086367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516a604-c115-4816-a91c-88155d8b8110 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.086612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516a604-c115-4816-a91c-88155d8b8110 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.090467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 283/569] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:36.091244 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757eb42-dc9b-40c4-aae9-afe3f1d7fd18 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.093849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516a604-c115-4816-a91c-88155d8b8110 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.095713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516a604-c115-4816-a91c-88155d8b8110 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.108892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-9516a604-c115-4816-a91c-88155d8b8110 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:39:36.110060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 287/570] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Oct 28 19:39:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:36.110824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516a604-c115-4816-a91c-88155d8b8110 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.187043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757eb42-dc9b-40c4-aae9-afe3f1d7fd18 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.202290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516a604-c115-4816-a91c-88155d8b8110 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.221365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362570a-6af5-4ddf-9fe8-35b726335cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.222194 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362570a-6af5-4ddf-9fe8-35b726335cce None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.222527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362570a-6af5-4ddf-9fe8-35b726335cce None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.222777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362570a-6af5-4ddf-9fe8-35b726335cce None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.232842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362570a-6af5-4ddf-9fe8-35b726335cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:36.233133 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3943f0e-0c3a-45ce-b27c-e0ed56aaadea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.233797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3943f0e-0c3a-45ce-b27c-e0ed56aaadea None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.234107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3943f0e-0c3a-45ce-b27c-e0ed56aaadea None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.234391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3943f0e-0c3a-45ce-b27c-e0ed56aaadea None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.235137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3943f0e-0c3a-45ce-b27c-e0ed56aaadea None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:36.235442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3943f0e-0c3a-45ce-b27c-e0ed56aaadea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.236831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3943f0e-0c3a-45ce-b27c-e0ed56aaadea None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.239866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a362570a-6af5-4ddf-9fe8-35b726335cce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:36.241022 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 284/571] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:36.241771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362570a-6af5-4ddf-9fe8-35b726335cce None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.244669 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 288/572] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:36.246926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3943f0e-0c3a-45ce-b27c-e0ed56aaadea None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.334633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362570a-6af5-4ddf-9fe8-35b726335cce None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.346301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3943f0e-0c3a-45ce-b27c-e0ed56aaadea None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.367292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7a66e-d791-47de-91bc-a1d8dd51b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.368093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7a66e-d791-47de-91bc-a1d8dd51b724 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.368364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7a66e-d791-47de-91bc-a1d8dd51b724 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.368631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7a66e-d791-47de-91bc-a1d8dd51b724 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.375839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7a66e-d791-47de-91bc-a1d8dd51b724 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.377307 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7a66e-d791-47de-91bc-a1d8dd51b724 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.379168 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6472a3-3fc9-4ed5-9367-cc37817a5822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.380031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6472a3-3fc9-4ed5-9367-cc37817a5822 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.380312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6472a3-3fc9-4ed5-9367-cc37817a5822 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.380585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6472a3-3fc9-4ed5-9367-cc37817a5822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.387342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6472a3-3fc9-4ed5-9367-cc37817a5822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.388831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6472a3-3fc9-4ed5-9367-cc37817a5822 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.390206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-1ab7a66e-d791-47de-91bc-a1d8dd51b724 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:39:36.391363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 285/573] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:36.392122 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7a66e-d791-47de-91bc-a1d8dd51b724 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.402620 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-4d6472a3-3fc9-4ed5-9367-cc37817a5822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:36.404055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 289/574] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:36.404735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6472a3-3fc9-4ed5-9367-cc37817a5822 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.485340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7a66e-d791-47de-91bc-a1d8dd51b724 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.498363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6472a3-3fc9-4ed5-9367-cc37817a5822 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.516771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21012c-1630-4540-be22-8fc50819f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.517438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21012c-1630-4540-be22-8fc50819f431 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.517720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21012c-1630-4540-be22-8fc50819f431 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.517981 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21012c-1630-4540-be22-8fc50819f431 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.518839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21012c-1630-4540-be22-8fc50819f431 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:36.519160 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21012c-1630-4540-be22-8fc50819f431 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.520643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21012c-1630-4540-be22-8fc50819f431 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.531649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563c0cd-4520-4d60-b566-222615e0ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.532305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c0cd-4520-4d60-b566-222615e0ef98 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.532586 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c0cd-4520-4d60-b566-222615e0ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.532855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c0cd-4520-4d60-b566-222615e0ef98 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.533597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563c0cd-4520-4d60-b566-222615e0ef98 None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:36.533893 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563c0cd-4520-4d60-b566-222615e0ef98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.535367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563c0cd-4520-4d60-b566-222615e0ef98 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.537398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 286/575] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:36.538217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21012c-1630-4540-be22-8fc50819f431 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.547890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 290/576] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:36.548695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563c0cd-4520-4d60-b566-222615e0ef98 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.631742 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21012c-1630-4540-be22-8fc50819f431 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.645941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563c0cd-4520-4d60-b566-222615e0ef98 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.664417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4853d1-be93-4295-bd88-42edfb2c9483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.665212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4853d1-be93-4295-bd88-42edfb2c9483 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.665488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4853d1-be93-4295-bd88-42edfb2c9483 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.665752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4853d1-be93-4295-bd88-42edfb2c9483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.675735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4853d1-be93-4295-bd88-42edfb2c9483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.677166 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4853d1-be93-4295-bd88-42edfb2c9483 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.678298 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500986d5-a003-41d7-a09b-5fa2cf279991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.678978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500986d5-a003-41d7-a09b-5fa2cf279991 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.679258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500986d5-a003-41d7-a09b-5fa2cf279991 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.679533 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500986d5-a003-41d7-a09b-5fa2cf279991 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.680371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500986d5-a003-41d7-a09b-5fa2cf279991 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:36.680683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500986d5-a003-41d7-a09b-5fa2cf279991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.682310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500986d5-a003-41d7-a09b-5fa2cf279991 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.693341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-3f4853d1-be93-4295-bd88-42edfb2c9483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:36.694547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 287/577] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:36.695301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4853d1-be93-4295-bd88-42edfb2c9483 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.705562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 291/578] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:36.705562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500986d5-a003-41d7-a09b-5fa2cf279991 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.787777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4853d1-be93-4295-bd88-42edfb2c9483 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.802409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500986d5-a003-41d7-a09b-5fa2cf279991 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.821761 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317773-9496-4949-b59c-3188844aaa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.822456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317773-9496-4949-b59c-3188844aaa88 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.822733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317773-9496-4949-b59c-3188844aaa88 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.823002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317773-9496-4949-b59c-3188844aaa88 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.823822 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317773-9496-4949-b59c-3188844aaa88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:36.824115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317773-9496-4949-b59c-3188844aaa88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.825539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317773-9496-4949-b59c-3188844aaa88 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.834878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f311f-38ea-4932-8490-7a29e8f06e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.835692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f311f-38ea-4932-8490-7a29e8f06e96 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.835971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f311f-38ea-4932-8490-7a29e8f06e96 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.836244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f311f-38ea-4932-8490-7a29e8f06e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.838329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 288/579] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:36.839180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317773-9496-4949-b59c-3188844aaa88 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.846216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f311f-38ea-4932-8490-7a29e8f06e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.847831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f311f-38ea-4932-8490-7a29e8f06e96 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.864602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-b68f311f-38ea-4932-8490-7a29e8f06e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:36.865811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 292/580] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:36.866597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f311f-38ea-4932-8490-7a29e8f06e96 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:36.934802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317773-9496-4949-b59c-3188844aaa88 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.959735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f311f-38ea-4932-8490-7a29e8f06e96 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:36.968861 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330705-209a-47cf-9b06-83bfd91fc36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.969655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330705-209a-47cf-9b06-83bfd91fc36b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.969927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330705-209a-47cf-9b06-83bfd91fc36b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.970224 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330705-209a-47cf-9b06-83bfd91fc36b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.980206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330705-209a-47cf-9b06-83bfd91fc36b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.981666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330705-209a-47cf-9b06-83bfd91fc36b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.992867 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaab0f7-2d9d-4cd2-9cfb-2b5127f1672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:36.993529 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaab0f7-2d9d-4cd2-9cfb-2b5127f1672b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:36.993807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaab0f7-2d9d-4cd2-9cfb-2b5127f1672b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:36.994105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaab0f7-2d9d-4cd2-9cfb-2b5127f1672b None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:36.994835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaab0f7-2d9d-4cd2-9cfb-2b5127f1672b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:36.995139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaab0f7-2d9d-4cd2-9cfb-2b5127f1672b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:36.996501 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaab0f7-2d9d-4cd2-9cfb-2b5127f1672b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:36.997858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-3a330705-209a-47cf-9b06-83bfd91fc36b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:36.999051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 289/581] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:36.999801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330705-209a-47cf-9b06-83bfd91fc36b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.007632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 293/582] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:37.008484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaab0f7-2d9d-4cd2-9cfb-2b5127f1672b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.095293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330705-209a-47cf-9b06-83bfd91fc36b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.106155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaab0f7-2d9d-4cd2-9cfb-2b5127f1672b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.128377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac020c5-a478-4b74-a234-1a7804132b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.129201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac020c5-a478-4b74-a234-1a7804132b84 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.129477 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac020c5-a478-4b74-a234-1a7804132b84 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.129731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac020c5-a478-4b74-a234-1a7804132b84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.137052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d853d83-8c12-45a3-9a2d-9ae3516a9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.137690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d853d83-8c12-45a3-9a2d-9ae3516a9c38 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.137955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d853d83-8c12-45a3-9a2d-9ae3516a9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.138270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d853d83-8c12-45a3-9a2d-9ae3516a9c38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.139088 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d853d83-8c12-45a3-9a2d-9ae3516a9c38 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=720ff448eaea42aaa7e399e5b950b01e) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:37.139399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d853d83-8c12-45a3-9a2d-9ae3516a9c38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.139885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac020c5-a478-4b74-a234-1a7804132b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.140825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d853d83-8c12-45a3-9a2d-9ae3516a9c38 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.141293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac020c5-a478-4b74-a234-1a7804132b84 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.146114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 294/583] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/role_assignments?user.id=720ff448eaea42aaa7e399e5b950b01e&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:37.146919 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d853d83-8c12-45a3-9a2d-9ae3516a9c38 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.157474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-9ac020c5-a478-4b74-a234-1a7804132b84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:37.163894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 290/584] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:37.163894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac020c5-a478-4b74-a234-1a7804132b84 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.249944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d853d83-8c12-45a3-9a2d-9ae3516a9c38 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.269304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac020c5-a478-4b74-a234-1a7804132b84 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.284020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e69182-462e-41aa-b59d-f8de7d6e162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.284705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e69182-462e-41aa-b59d-f8de7d6e162a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.285041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e69182-462e-41aa-b59d-f8de7d6e162a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.285316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e69182-462e-41aa-b59d-f8de7d6e162a None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.286193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e69182-462e-41aa-b59d-f8de7d6e162a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:37.286383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e69182-462e-41aa-b59d-f8de7d6e162a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.287806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e69182-462e-41aa-b59d-f8de7d6e162a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.301026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 295/585] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:37.302247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e69182-462e-41aa-b59d-f8de7d6e162a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.308448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9df46-fdf8-4ca7-a9ce-5f648eb99d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.309259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9df46-fdf8-4ca7-a9ce-5f648eb99d8d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.309603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9df46-fdf8-4ca7-a9ce-5f648eb99d8d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.309943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9df46-fdf8-4ca7-a9ce-5f648eb99d8d None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.310776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9df46-fdf8-4ca7-a9ce-5f648eb99d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:37.311079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9df46-fdf8-4ca7-a9ce-5f648eb99d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.312507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9df46-fdf8-4ca7-a9ce-5f648eb99d8d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.329935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 291/586] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:37.329935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9df46-fdf8-4ca7-a9ce-5f648eb99d8d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.398662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e69182-462e-41aa-b59d-f8de7d6e162a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.424709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9df46-fdf8-4ca7-a9ce-5f648eb99d8d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.432997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ab54-06f7-4511-9aaf-cf7d16afa71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.433813 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ab54-06f7-4511-9aaf-cf7d16afa71e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.434122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ab54-06f7-4511-9aaf-cf7d16afa71e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.434398 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ab54-06f7-4511-9aaf-cf7d16afa71e None admin] PATH_INFO: `/v3/users/glance` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.441474 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59ab54-06f7-4511-9aaf-cf7d16afa71e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.442959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59ab54-06f7-4511-9aaf-cf7d16afa71e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.457184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-3c59ab54-06f7-4511-9aaf-cf7d16afa71e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:39:37.457406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbdf9c-58c9-4717-97ee-b73d58615be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.458048 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbdf9c-58c9-4717-97ee-b73d58615be0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.458352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbdf9c-58c9-4717-97ee-b73d58615be0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.458620 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbdf9c-58c9-4717-97ee-b73d58615be0 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.459287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 296/587] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:37.459386 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbdf9c-58c9-4717-97ee-b73d58615be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:37.459616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbdf9c-58c9-4717-97ee-b73d58615be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.460456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ab54-06f7-4511-9aaf-cf7d16afa71e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.460986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbdf9c-58c9-4717-97ee-b73d58615be0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.472259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 292/588] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:37.473150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbdf9c-58c9-4717-97ee-b73d58615be0 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.558369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ab54-06f7-4511-9aaf-cf7d16afa71e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.572242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbdf9c-58c9-4717-97ee-b73d58615be0 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.590368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520c0c8-0dbd-4794-bce7-e08cce7ae002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.591167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c0c8-0dbd-4794-bce7-e08cce7ae002 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.591443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c0c8-0dbd-4794-bce7-e08cce7ae002 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.591703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c0c8-0dbd-4794-bce7-e08cce7ae002 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.598291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520c0c8-0dbd-4794-bce7-e08cce7ae002 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.599729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520c0c8-0dbd-4794-bce7-e08cce7ae002 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.605760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6a395-5482-443e-9ba6-38eeff54bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.606600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6a395-5482-443e-9ba6-38eeff54bbdd None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.606881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6a395-5482-443e-9ba6-38eeff54bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.607151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6a395-5482-443e-9ba6-38eeff54bbdd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.612447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-d520c0c8-0dbd-4794-bce7-e08cce7ae002 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:37.618546 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 297/589] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:37.618666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6a395-5482-443e-9ba6-38eeff54bbdd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.618741 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520c0c8-0dbd-4794-bce7-e08cce7ae002 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.618827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6a395-5482-443e-9ba6-38eeff54bbdd None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.632094 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-61e6a395-5482-443e-9ba6-38eeff54bbdd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:39:37.633447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 293/590] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:37.634503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6a395-5482-443e-9ba6-38eeff54bbdd None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.712606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520c0c8-0dbd-4794-bce7-e08cce7ae002 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.735006 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6a395-5482-443e-9ba6-38eeff54bbdd None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.743631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedfb1b-23e7-47e9-a3b1-e95afa0cc267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.744306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedfb1b-23e7-47e9-a3b1-e95afa0cc267 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.744587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedfb1b-23e7-47e9-a3b1-e95afa0cc267 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.744865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedfb1b-23e7-47e9-a3b1-e95afa0cc267 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.745698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedfb1b-23e7-47e9-a3b1-e95afa0cc267 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:37.746004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedfb1b-23e7-47e9-a3b1-e95afa0cc267 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.747475 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedfb1b-23e7-47e9-a3b1-e95afa0cc267 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.764077 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 298/591] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:37.765213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedfb1b-23e7-47e9-a3b1-e95afa0cc267 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.771046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416004c-4c85-452d-80c0-60a955ee80b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.771858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416004c-4c85-452d-80c0-60a955ee80b6 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.772140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416004c-4c85-452d-80c0-60a955ee80b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.772469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416004c-4c85-452d-80c0-60a955ee80b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.779633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416004c-4c85-452d-80c0-60a955ee80b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.781088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416004c-4c85-452d-80c0-60a955ee80b6 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.795163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-c416004c-4c85-452d-80c0-60a955ee80b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:37.801444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 294/592] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:37.801444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416004c-4c85-452d-80c0-60a955ee80b6 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.862185 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedfb1b-23e7-47e9-a3b1-e95afa0cc267 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.894213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a997d22-fe76-4411-ad7f-b483cd3cabeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.895012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a997d22-fe76-4411-ad7f-b483cd3cabeb None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.895286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a997d22-fe76-4411-ad7f-b483cd3cabeb None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.895607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a997d22-fe76-4411-ad7f-b483cd3cabeb None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.896393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a997d22-fe76-4411-ad7f-b483cd3cabeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:37.896680 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416004c-4c85-452d-80c0-60a955ee80b6 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:37.896778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a997d22-fe76-4411-ad7f-b483cd3cabeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.898128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a997d22-fe76-4411-ad7f-b483cd3cabeb None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.909426 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 299/593] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:37.910181 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a997d22-fe76-4411-ad7f-b483cd3cabeb None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:37.930821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593d5a1-16ac-440c-9a5a-8fa0377b5089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:37.931498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593d5a1-16ac-440c-9a5a-8fa0377b5089 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:37.931979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593d5a1-16ac-440c-9a5a-8fa0377b5089 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:37.932082 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593d5a1-16ac-440c-9a5a-8fa0377b5089 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:37.932864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593d5a1-16ac-440c-9a5a-8fa0377b5089 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:37.933163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593d5a1-16ac-440c-9a5a-8fa0377b5089 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:37.934874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593d5a1-16ac-440c-9a5a-8fa0377b5089 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:37.956049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 295/594] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:37.956049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593d5a1-16ac-440c-9a5a-8fa0377b5089 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.008735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a997d22-fe76-4411-ad7f-b483cd3cabeb None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.040851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6fa4-326b-4d14-8908-7919ce3f9e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.041665 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6fa4-326b-4d14-8908-7919ce3f9e55 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.041945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6fa4-326b-4d14-8908-7919ce3f9e55 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.042250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6fa4-326b-4d14-8908-7919ce3f9e55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.049587 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593d5a1-16ac-440c-9a5a-8fa0377b5089 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.053559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f6fa4-326b-4d14-8908-7919ce3f9e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.055071 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f6fa4-326b-4d14-8908-7919ce3f9e55 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.071132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c03f6fa4-326b-4d14-8908-7919ce3f9e55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:38.072300 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 300/595] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:38.073039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6fa4-326b-4d14-8908-7919ce3f9e55 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.089437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d502c2-fb6d-495b-83ad-33feee098d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.090173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d502c2-fb6d-495b-83ad-33feee098d49 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.090401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d502c2-fb6d-495b-83ad-33feee098d49 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.090673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d502c2-fb6d-495b-83ad-33feee098d49 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.091451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d502c2-fb6d-495b-83ad-33feee098d49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:38.091752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d502c2-fb6d-495b-83ad-33feee098d49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.093179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d502c2-fb6d-495b-83ad-33feee098d49 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.104968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 296/596] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:38.106179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d502c2-fb6d-495b-83ad-33feee098d49 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.170312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6fa4-326b-4d14-8908-7919ce3f9e55 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.203166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e258-e685-4803-ae0f-f4712abaf0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.204072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e258-e685-4803-ae0f-f4712abaf0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.204383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e258-e685-4803-ae0f-f4712abaf0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.204603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e258-e685-4803-ae0f-f4712abaf0a7 None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/be7be85d70b64273b7904082ee2ba848/roles/143037337c76416d8ad332410c456159` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.209314 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d502c2-fb6d-495b-83ad-33feee098d49 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.218828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8e258-e685-4803-ae0f-f4712abaf0a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=be7be85d70b64273b7904082ee2ba848, role_id=143037337c76416d8ad332410c456159)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.220279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8e258-e685-4803-ae0f-f4712abaf0a7 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.242326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 301/597] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:39:38 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/be7be85d70b64273b7904082ee2ba848/roles/143037337c76416d8ad332410c456159 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:39:38.242326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e258-e685-4803-ae0f-f4712abaf0a7 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.252373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e98fb-5f2d-4090-80a3-d5b334c85f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.253289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e98fb-5f2d-4090-80a3-d5b334c85f0f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.253566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e98fb-5f2d-4090-80a3-d5b334c85f0f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.253901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e98fb-5f2d-4090-80a3-d5b334c85f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.267099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e98fb-5f2d-4090-80a3-d5b334c85f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.268568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e98fb-5f2d-4090-80a3-d5b334c85f0f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.288415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-e29e98fb-5f2d-4090-80a3-d5b334c85f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:38.294579 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 297/598] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:38.295521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e98fb-5f2d-4090-80a3-d5b334c85f0f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.343059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e258-e685-4803-ae0f-f4712abaf0a7 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.378569 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f2584-1e28-40a1-8909-49e808c4008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.379333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f2584-1e28-40a1-8909-49e808c4008a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.379615 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f2584-1e28-40a1-8909-49e808c4008a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.379887 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f2584-1e28-40a1-8909-49e808c4008a None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.380631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f2584-1e28-40a1-8909-49e808c4008a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:38.380950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f2584-1e28-40a1-8909-49e808c4008a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.382359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f2584-1e28-40a1-8909-49e808c4008a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.398573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 302/599] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:38.399552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f2584-1e28-40a1-8909-49e808c4008a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.406846 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e98fb-5f2d-4090-80a3-d5b334c85f0f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.443200 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343506-6e60-49de-b6a8-31eb22d2161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.444113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343506-6e60-49de-b6a8-31eb22d2161e None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.444442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343506-6e60-49de-b6a8-31eb22d2161e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.444712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343506-6e60-49de-b6a8-31eb22d2161e None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/ba2e2211f5d14ebcbd0221278248b868/roles/143037337c76416d8ad332410c456159` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.460987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343506-6e60-49de-b6a8-31eb22d2161e None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=ba2e2211f5d14ebcbd0221278248b868, role_id=143037337c76416d8ad332410c456159)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.462489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343506-6e60-49de-b6a8-31eb22d2161e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.479835 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 298/600] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:39:38 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/ba2e2211f5d14ebcbd0221278248b868/roles/143037337c76416d8ad332410c456159 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:39:38.480407 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343506-6e60-49de-b6a8-31eb22d2161e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.510390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f2584-1e28-40a1-8909-49e808c4008a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.561050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8ea1a-bd7f-4a5f-a74d-bc028633e182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.562036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ea1a-bd7f-4a5f-a74d-bc028633e182 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.562545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ea1a-bd7f-4a5f-a74d-bc028633e182 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.563054 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ea1a-bd7f-4a5f-a74d-bc028633e182 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.564007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8ea1a-bd7f-4a5f-a74d-bc028633e182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:38.564506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8ea1a-bd7f-4a5f-a74d-bc028633e182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.566267 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8ea1a-bd7f-4a5f-a74d-bc028633e182 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.584358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 303/601] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:38.586024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8ea1a-bd7f-4a5f-a74d-bc028633e182 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.608610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343506-6e60-49de-b6a8-31eb22d2161e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.647557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b16d19-1941-4181-b827-001d291f3d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.648460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b16d19-1941-4181-b827-001d291f3d1d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.648638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b16d19-1941-4181-b827-001d291f3d1d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.648925 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b16d19-1941-4181-b827-001d291f3d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.656287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b16d19-1941-4181-b827-001d291f3d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.657762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b16d19-1941-4181-b827-001d291f3d1d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.671719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-91b16d19-1941-4181-b827-001d291f3d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:38.673259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 299/602] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:38.679327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b16d19-1941-4181-b827-001d291f3d1d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.703200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8ea1a-bd7f-4a5f-a74d-bc028633e182 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.768675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52158-28f2-4b0f-ba50-96c55fa7e63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.769481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52158-28f2-4b0f-ba50-96c55fa7e63b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.769710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52158-28f2-4b0f-ba50-96c55fa7e63b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.769997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52158-28f2-4b0f-ba50-96c55fa7e63b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.777283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b52158-28f2-4b0f-ba50-96c55fa7e63b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.778959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b52158-28f2-4b0f-ba50-96c55fa7e63b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.793005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-e6b52158-28f2-4b0f-ba50-96c55fa7e63b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:38.800215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 304/603] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:38.806646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52158-28f2-4b0f-ba50-96c55fa7e63b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.825233 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b16d19-1941-4181-b827-001d291f3d1d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.859239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f583cb5-c171-466d-ba9b-137c58ef7e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.860152 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f583cb5-c171-466d-ba9b-137c58ef7e89 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.860576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f583cb5-c171-466d-ba9b-137c58ef7e89 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.861015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f583cb5-c171-466d-ba9b-137c58ef7e89 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.862007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f583cb5-c171-466d-ba9b-137c58ef7e89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:38.862546 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f583cb5-c171-466d-ba9b-137c58ef7e89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.864997 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f583cb5-c171-466d-ba9b-137c58ef7e89 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.878287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 300/604] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:38.884213 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f583cb5-c171-466d-ba9b-137c58ef7e89 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.916320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52158-28f2-4b0f-ba50-96c55fa7e63b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:38.951332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fbc66-ba2b-4759-ad35-32509a6271ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:38.952365 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbc66-ba2b-4759-ad35-32509a6271ec None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:38.952824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbc66-ba2b-4759-ad35-32509a6271ec None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:38.953267 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbc66-ba2b-4759-ad35-32509a6271ec None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:38.954283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fbc66-ba2b-4759-ad35-32509a6271ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:38.954764 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fbc66-ba2b-4759-ad35-32509a6271ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:38.956436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fbc66-ba2b-4759-ad35-32509a6271ec None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:38.969596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 305/605] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:38.985302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fbc66-ba2b-4759-ad35-32509a6271ec None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:38.988795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f583cb5-c171-466d-ba9b-137c58ef7e89 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:39.023858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0ccd0-cf60-4e92-be10-abec94f1f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:39.026100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ccd0-cf60-4e92-be10-abec94f1f5ec None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:39.026378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ccd0-cf60-4e92-be10-abec94f1f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:39.026655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ccd0-cf60-4e92-be10-abec94f1f5ec None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/f94515985e244af29f47a49c0dd415ec/roles/143037337c76416d8ad332410c456159` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:39.060769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0ccd0-cf60-4e92-be10-abec94f1f5ec None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=f94515985e244af29f47a49c0dd415ec, role_id=143037337c76416d8ad332410c456159)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:39.063614 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0ccd0-cf60-4e92-be10-abec94f1f5ec None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:39.090299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 301/606] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:39:38 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/f94515985e244af29f47a49c0dd415ec/roles/143037337c76416d8ad332410c456159 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:39:39.135215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fbc66-ba2b-4759-ad35-32509a6271ec None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:39.170124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822da445-b762-428f-9efb-bdc05872331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:39.171055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822da445-b762-428f-9efb-bdc05872331c None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:39.171338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822da445-b762-428f-9efb-bdc05872331c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:39.171610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822da445-b762-428f-9efb-bdc05872331c None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/444a88451fbd4814b6d81023e68b54a7/roles/143037337c76416d8ad332410c456159` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:39.194654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822da445-b762-428f-9efb-bdc05872331c None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=444a88451fbd4814b6d81023e68b54a7, role_id=143037337c76416d8ad332410c456159)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:39.196166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822da445-b762-428f-9efb-bdc05872331c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:39.221313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 306/607] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:39:38 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/444a88451fbd4814b6d81023e68b54a7/roles/143037337c76416d8ad332410c456159 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:39:39.601948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa588a-7868-4b33-8bee-b22cb3a7c033 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:39.602366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa588a-7868-4b33-8bee-b22cb3a7c033 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:39.602625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa588a-7868-4b33-8bee-b22cb3a7c033 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:39.604584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 302/608] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:39.610285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32f6c7-e990-48a5-9f60-f3d370bb32ed None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:39.610576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32f6c7-e990-48a5-9f60-f3d370bb32ed None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:39.610854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32f6c7-e990-48a5-9f60-f3d370bb32ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:39.631096 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-bf32f6c7-e990-48a5-9f60-f3d370bb32ed None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:39.632280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-bf32f6c7-e990-48a5-9f60-f3d370bb32ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:39.723941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 307/609] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:39.751022 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa588a-7868-4b33-8bee-b22cb3a7c033 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:39.852495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa588a-7868-4b33-8bee-b22cb3a7c033 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:39.888300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5155c97-7498-4c4f-a004-b8918da1b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:39.889447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5155c97-7498-4c4f-a004-b8918da1b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:39.889872 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5155c97-7498-4c4f-a004-b8918da1b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:39.890371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5155c97-7498-4c4f-a004-b8918da1b1a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:39.902388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5155c97-7498-4c4f-a004-b8918da1b1a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:39.909858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-f5155c97-7498-4c4f-a004-b8918da1b1a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:39.911632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 303/610] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:39.919187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32f6c7-e990-48a5-9f60-f3d370bb32ed None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:40.033435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32f6c7-e990-48a5-9f60-f3d370bb32ed None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:40.075524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a54576-ee9d-4a6a-b4dd-ad13b8aaa633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:40.076588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a54576-ee9d-4a6a-b4dd-ad13b8aaa633 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:40.077092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a54576-ee9d-4a6a-b4dd-ad13b8aaa633 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:40.077563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a54576-ee9d-4a6a-b4dd-ad13b8aaa633 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:40.080831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a54576-ee9d-4a6a-b4dd-ad13b8aaa633 None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:40.081341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a54576-ee9d-4a6a-b4dd-ad13b8aaa633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:40.083017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a54576-ee9d-4a6a-b4dd-ad13b8aaa633 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:40.093790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 308/611] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:40.100000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5155c97-7498-4c4f-a004-b8918da1b1a5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:40.199459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5155c97-7498-4c4f-a004-b8918da1b1a5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:40.233124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ebf5-8687-46b5-8423-d55593e7dfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:40.234497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ebf5-8687-46b5-8423-d55593e7dfee None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:40.234973 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ebf5-8687-46b5-8423-d55593e7dfee None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:40.235463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ebf5-8687-46b5-8423-d55593e7dfee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:40.246464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0ebf5-8687-46b5-8423-d55593e7dfee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:40.248202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0ebf5-8687-46b5-8423-d55593e7dfee None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:40.264768 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-60b0ebf5-8687-46b5-8423-d55593e7dfee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:40.266536 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 304/612] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:40.274441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a54576-ee9d-4a6a-b4dd-ad13b8aaa633 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:40.400066 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a54576-ee9d-4a6a-b4dd-ad13b8aaa633 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:40.441118 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36057dc-36ce-4845-b1f7-542a40736438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:40.442359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36057dc-36ce-4845-b1f7-542a40736438 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:40.442877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36057dc-36ce-4845-b1f7-542a40736438 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:40.443364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36057dc-36ce-4845-b1f7-542a40736438 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:40.444337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36057dc-36ce-4845-b1f7-542a40736438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:40.444852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36057dc-36ce-4845-b1f7-542a40736438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:40.446462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36057dc-36ce-4845-b1f7-542a40736438 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:40.463246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 309/613] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:40.468625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ebf5-8687-46b5-8423-d55593e7dfee None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:40.615480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ebf5-8687-46b5-8423-d55593e7dfee None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:40.683769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe905a-95a8-4241-8510-b40ae1d81b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:40.684593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe905a-95a8-4241-8510-b40ae1d81b0f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:40.684869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe905a-95a8-4241-8510-b40ae1d81b0f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:40.685137 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe905a-95a8-4241-8510-b40ae1d81b0f None admin] PATH_INFO: `/v3/users/swift` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:40.703222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe905a-95a8-4241-8510-b40ae1d81b0f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:40.704678 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe905a-95a8-4241-8510-b40ae1d81b0f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:40.722893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-f4fe905a-95a8-4241-8510-b40ae1d81b0f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:39:40.724503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 305/614] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:40.730284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36057dc-36ce-4845-b1f7-542a40736438 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:40.876242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36057dc-36ce-4845-b1f7-542a40736438 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:40.911918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c511fc-c61a-4de3-8ca3-19102fa60b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:40.912947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c511fc-c61a-4de3-8ca3-19102fa60b5a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:40.913400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c511fc-c61a-4de3-8ca3-19102fa60b5a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:40.913854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c511fc-c61a-4de3-8ca3-19102fa60b5a None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:40.914883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c511fc-c61a-4de3-8ca3-19102fa60b5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:40.915377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c511fc-c61a-4de3-8ca3-19102fa60b5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:40.916998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c511fc-c61a-4de3-8ca3-19102fa60b5a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:40.937878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 310/615] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Oct 28 19:39:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:40.946211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe905a-95a8-4241-8510-b40ae1d81b0f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:41.081836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe905a-95a8-4241-8510-b40ae1d81b0f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:41.121570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e0108-f6b4-454f-bda0-a8dced1a56b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:41.122404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e0108-f6b4-454f-bda0-a8dced1a56b9 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:41.122683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e0108-f6b4-454f-bda0-a8dced1a56b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:41.122953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e0108-f6b4-454f-bda0-a8dced1a56b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:41.133635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e0108-f6b4-454f-bda0-a8dced1a56b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:41.135122 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e0108-f6b4-454f-bda0-a8dced1a56b9 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:41.162399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-dd1e0108-f6b4-454f-bda0-a8dced1a56b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:41.163940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 306/616] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:41.169542 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c511fc-c61a-4de3-8ca3-19102fa60b5a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:41.310023 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c511fc-c61a-4de3-8ca3-19102fa60b5a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:41.351729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c37462-c20a-41e9-be6a-d72d667eaae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:41.352787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c37462-c20a-41e9-be6a-d72d667eaae7 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:41.353263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c37462-c20a-41e9-be6a-d72d667eaae7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:41.353795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c37462-c20a-41e9-be6a-d72d667eaae7 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:41.354830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c37462-c20a-41e9-be6a-d72d667eaae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:41.355344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c37462-c20a-41e9-be6a-d72d667eaae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:41.356932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c37462-c20a-41e9-be6a-d72d667eaae7 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:41.375087 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 311/617] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:41.380734 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e0108-f6b4-454f-bda0-a8dced1a56b9 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:41.408694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfd85f-9395-4323-82bd-542f231934e7 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:41.409042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfd85f-9395-4323-82bd-542f231934e7 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:41.409247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfd85f-9395-4323-82bd-542f231934e7 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:41.411401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 312/618] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:41.427994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ae0ca-74a9-4f0f-aee7-59d9925955ca None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:41.428381 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ae0ca-74a9-4f0f-aee7-59d9925955ca None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:41.428567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ae0ca-74a9-4f0f-aee7-59d9925955ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:41.463464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-5a3ae0ca-74a9-4f0f-aee7-59d9925955ca None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:41.464300 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5a3ae0ca-74a9-4f0f-aee7-59d9925955ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:41.493573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e0108-f6b4-454f-bda0-a8dced1a56b9 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:41.527673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa7dd-414d-4576-8e41-fdf28df6b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:41.528919 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa7dd-414d-4576-8e41-fdf28df6b812 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:41.529518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa7dd-414d-4576-8e41-fdf28df6b812 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:41.529980 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa7dd-414d-4576-8e41-fdf28df6b812 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:41.537229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fa7dd-414d-4576-8e41-fdf28df6b812 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:41.538949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fa7dd-414d-4576-8e41-fdf28df6b812 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:41.554286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-541fa7dd-414d-4576-8e41-fdf28df6b812 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:41.556233 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 307/619] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:41.562509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa7dd-414d-4576-8e41-fdf28df6b812 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:41.627490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 313/620] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:41.628864 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c130-b24f-4714-a2bf-f543c10d2646 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:41.629201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c130-b24f-4714-a2bf-f543c10d2646 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:41.629482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c130-b24f-4714-a2bf-f543c10d2646 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:41.631576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 314/621] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:41.636720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf5814-4bda-4364-95e8-e30345b94eff None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:41.637006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf5814-4bda-4364-95e8-e30345b94eff None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:41.637285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf5814-4bda-4364-95e8-e30345b94eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:41.656804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-76bf5814-4bda-4364-95e8-e30345b94eff None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:41.658176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-76bf5814-4bda-4364-95e8-e30345b94eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:41.679460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa7dd-414d-4576-8e41-fdf28df6b812 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:41.715201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bf90f-df96-4461-8395-402cc02389e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:41.715923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bf90f-df96-4461-8395-402cc02389e1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:41.716204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bf90f-df96-4461-8395-402cc02389e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:41.716479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bf90f-df96-4461-8395-402cc02389e1 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:41.717325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bf90f-df96-4461-8395-402cc02389e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:41.717760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bf90f-df96-4461-8395-402cc02389e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:41.719186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bf90f-df96-4461-8395-402cc02389e1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:41.732211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 308/622] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:41.733148 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bf90f-df96-4461-8395-402cc02389e1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:41.739935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 315/623] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:41.740811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf5814-4bda-4364-95e8-e30345b94eff None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:41.868134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bf90f-df96-4461-8395-402cc02389e1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:41.869890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf5814-4bda-4364-95e8-e30345b94eff None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:41.904856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5984e57-3605-4453-ba56-ef76b8a3503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:41.905631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984e57-3605-4453-ba56-ef76b8a3503c None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:41.905910 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984e57-3605-4453-ba56-ef76b8a3503c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:41.906239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984e57-3605-4453-ba56-ef76b8a3503c None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/720ff448eaea42aaa7e399e5b950b01e/roles/143037337c76416d8ad332410c456159` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:41.908044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ae5c0-0c16-4048-a8e8-a61a71982b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:41.909079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ae5c0-0c16-4048-a8e8-a61a71982b2e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:41.910262 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ae5c0-0c16-4048-a8e8-a61a71982b2e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:41.910733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ae5c0-0c16-4048-a8e8-a61a71982b2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:41.922399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5984e57-3605-4453-ba56-ef76b8a3503c None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=720ff448eaea42aaa7e399e5b950b01e, role_id=143037337c76416d8ad332410c456159)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:41.922598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ae5c0-0c16-4048-a8e8-a61a71982b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:41.923946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5984e57-3605-4453-ba56-ef76b8a3503c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:41.931379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-234ae5c0-0c16-4048-a8e8-a61a71982b2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:41.932969 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 309/624] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:41.934312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ae5c0-0c16-4048-a8e8-a61a71982b2e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:41.947249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 316/625] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:39:41 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/720ff448eaea42aaa7e399e5b950b01e/roles/143037337c76416d8ad332410c456159 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:39:41.948270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5984e57-3605-4453-ba56-ef76b8a3503c None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:42.053966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ae5c0-0c16-4048-a8e8-a61a71982b2e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:42.069387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5984e57-3605-4453-ba56-ef76b8a3503c None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:42.110618 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ba034-23b1-4c3c-911a-c257e5e86777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:42.111557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ba034-23b1-4c3c-911a-c257e5e86777 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.111840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ba034-23b1-4c3c-911a-c257e5e86777 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.112112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ba034-23b1-4c3c-911a-c257e5e86777 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.134190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ba034-23b1-4c3c-911a-c257e5e86777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:42.145223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a07ba034-23b1-4c3c-911a-c257e5e86777 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:42.146543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 310/626] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:42.155983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e34709-5027-46d0-8ddf-b8f0a006c094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:42.156615 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e34709-5027-46d0-8ddf-b8f0a006c094 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.156938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e34709-5027-46d0-8ddf-b8f0a006c094 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.157211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e34709-5027-46d0-8ddf-b8f0a006c094 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.157995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e34709-5027-46d0-8ddf-b8f0a006c094 None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:42.158373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e34709-5027-46d0-8ddf-b8f0a006c094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:42.159795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e34709-5027-46d0-8ddf-b8f0a006c094 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:42.161967 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ba034-23b1-4c3c-911a-c257e5e86777 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:42.178355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 317/627] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:42.180513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa696e53-8c2b-4a90-abe3-278fbd5223b8 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.180981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa696e53-8c2b-4a90-abe3-278fbd5223b8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.181251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa696e53-8c2b-4a90-abe3-278fbd5223b8 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.183182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 318/628] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:42.184925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91612a69-e0d2-4dea-be98-d47b81047315 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.185402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91612a69-e0d2-4dea-be98-d47b81047315 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.185850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91612a69-e0d2-4dea-be98-d47b81047315 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.188508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 319/629] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:42.189468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91612a69-e0d2-4dea-be98-d47b81047315 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:42.276524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ba034-23b1-4c3c-911a-c257e5e86777 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:42.291226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91612a69-e0d2-4dea-be98-d47b81047315 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:42.311385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cd875-c4d6-4e21-8d01-cf7153c5a9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:42.312062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cd875-c4d6-4e21-8d01-cf7153c5a9bb None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.312355 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cd875-c4d6-4e21-8d01-cf7153c5a9bb None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.312628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cd875-c4d6-4e21-8d01-cf7153c5a9bb None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.313383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cd875-c4d6-4e21-8d01-cf7153c5a9bb None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:42.313686 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cd875-c4d6-4e21-8d01-cf7153c5a9bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:42.315116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cd875-c4d6-4e21-8d01-cf7153c5a9bb None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:42.323727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 311/630] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:42.324962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f1a04-3464-4449-813d-c19fa4cce583 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.325250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f1a04-3464-4449-813d-c19fa4cce583 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.325527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f1a04-3464-4449-813d-c19fa4cce583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.330775 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a5a87-9340-4a11-9b53-360dcfde7592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:42.331774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a5a87-9340-4a11-9b53-360dcfde7592 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.332332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a5a87-9340-4a11-9b53-360dcfde7592 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.332603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a5a87-9340-4a11-9b53-360dcfde7592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.343286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e46f1a04-3464-4449-813d-c19fa4cce583 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:42.343448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a5a87-9340-4a11-9b53-360dcfde7592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:42.344466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e46f1a04-3464-4449-813d-c19fa4cce583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:42.344891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a5a87-9340-4a11-9b53-360dcfde7592 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:42.363302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-616a5a87-9340-4a11-9b53-360dcfde7592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:42.368987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 320/631] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:42.368987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b3446-c567-4fd3-ad55-2b1a74156bc5 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.368987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b3446-c567-4fd3-ad55-2b1a74156bc5 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.368987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b3446-c567-4fd3-ad55-2b1a74156bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.383127 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-566b3446-c567-4fd3-ad55-2b1a74156bc5 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:42.384410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-566b3446-c567-4fd3-ad55-2b1a74156bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:42.415927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 312/632] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:42.416738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f1a04-3464-4449-813d-c19fa4cce583 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:42.450523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 321/633] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:42.451788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b3446-c567-4fd3-ad55-2b1a74156bc5 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:42.525631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f1a04-3464-4449-813d-c19fa4cce583 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:42.547531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b3446-c567-4fd3-ad55-2b1a74156bc5 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:42.558721 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ce09a-0bbf-412e-8580-a96fae17f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:42.559526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ce09a-0bbf-412e-8580-a96fae17f362 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.559807 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ce09a-0bbf-412e-8580-a96fae17f362 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.560079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ce09a-0bbf-412e-8580-a96fae17f362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.569897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ce09a-0bbf-412e-8580-a96fae17f362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:42.571430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ce09a-0bbf-412e-8580-a96fae17f362 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:42.582073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0541999-9b6b-4a79-aa8d-cfdb5cb5f2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:42.582836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0541999-9b6b-4a79-aa8d-cfdb5cb5f2d2 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.583128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0541999-9b6b-4a79-aa8d-cfdb5cb5f2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.583389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0541999-9b6b-4a79-aa8d-cfdb5cb5f2d2 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.584110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0541999-9b6b-4a79-aa8d-cfdb5cb5f2d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:42.584414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0541999-9b6b-4a79-aa8d-cfdb5cb5f2d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:42.585776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0541999-9b6b-4a79-aa8d-cfdb5cb5f2d2 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:42.588301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-ed8ce09a-0bbf-412e-8580-a96fae17f362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:42.594159 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 313/634] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:42.594159 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ce09a-0bbf-412e-8580-a96fae17f362 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:42.597400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 322/635] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:42.598463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0541999-9b6b-4a79-aa8d-cfdb5cb5f2d2 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:42.693952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0541999-9b6b-4a79-aa8d-cfdb5cb5f2d2 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:42.700913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ce09a-0bbf-412e-8580-a96fae17f362 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:42.731351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51012f4a-8f7e-4833-889c-0eb3bd89b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:42.732158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51012f4a-8f7e-4833-889c-0eb3bd89b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.732439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51012f4a-8f7e-4833-889c-0eb3bd89b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.732715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51012f4a-8f7e-4833-889c-0eb3bd89b0b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.734352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c9822-afd8-4b80-b9f7-845c34dd137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:42.735160 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c9822-afd8-4b80-b9f7-845c34dd137e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.735442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c9822-afd8-4b80-b9f7-845c34dd137e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.735730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c9822-afd8-4b80-b9f7-845c34dd137e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.743124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51012f4a-8f7e-4833-889c-0eb3bd89b0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:42.745573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c9822-afd8-4b80-b9f7-845c34dd137e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:42.750159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-51012f4a-8f7e-4833-889c-0eb3bd89b0b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:42.756864 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 323/636] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:42.756864 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51012f4a-8f7e-4833-889c-0eb3bd89b0b3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:42.757065 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-1c9c9822-afd8-4b80-b9f7-845c34dd137e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:42.757065 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 314/637] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:42.757065 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c9822-afd8-4b80-b9f7-845c34dd137e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:42.857738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c9822-afd8-4b80-b9f7-845c34dd137e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:42.863903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51012f4a-8f7e-4833-889c-0eb3bd89b0b3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:42.890432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff95ec-836a-4dcc-af5e-d2701b5af5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:42.891369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff95ec-836a-4dcc-af5e-d2701b5af5f2 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.891753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff95ec-836a-4dcc-af5e-d2701b5af5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.892023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff95ec-836a-4dcc-af5e-d2701b5af5f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.896745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cee635-2596-438b-a982-fb76eaa42278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:42.897424 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cee635-2596-438b-a982-fb76eaa42278 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:42.897707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cee635-2596-438b-a982-fb76eaa42278 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:42.897982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cee635-2596-438b-a982-fb76eaa42278 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:42.898746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cee635-2596-438b-a982-fb76eaa42278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:42.899050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cee635-2596-438b-a982-fb76eaa42278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:42.899602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff95ec-836a-4dcc-af5e-d2701b5af5f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:42.900482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cee635-2596-438b-a982-fb76eaa42278 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:42.901018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff95ec-836a-4dcc-af5e-d2701b5af5f2 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:42.916939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 324/638] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:42.916939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cee635-2596-438b-a982-fb76eaa42278 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:42.917189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-36ff95ec-836a-4dcc-af5e-d2701b5af5f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:39:42.917189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 315/639] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Oct 28 19:39:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:42.917189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff95ec-836a-4dcc-af5e-d2701b5af5f2 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.011165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff95ec-836a-4dcc-af5e-d2701b5af5f2 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.012630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cee635-2596-438b-a982-fb76eaa42278 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.044859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c35835-6262-4a00-8b26-32907425abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.045645 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c35835-6262-4a00-8b26-32907425abf7 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.045931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c35835-6262-4a00-8b26-32907425abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.046239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c35835-6262-4a00-8b26-32907425abf7 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.046986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c35835-6262-4a00-8b26-32907425abf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:43.047284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c35835-6262-4a00-8b26-32907425abf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.048673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c35835-6262-4a00-8b26-32907425abf7 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.049120 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9efd2-ce7e-43ee-b1ac-cc699a6f60de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.050031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9efd2-ce7e-43ee-b1ac-cc699a6f60de None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.050477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9efd2-ce7e-43ee-b1ac-cc699a6f60de None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.051279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9efd2-ce7e-43ee-b1ac-cc699a6f60de None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.052169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9efd2-ce7e-43ee-b1ac-cc699a6f60de None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:43.052630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9efd2-ce7e-43ee-b1ac-cc699a6f60de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.054191 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9efd2-ce7e-43ee-b1ac-cc699a6f60de None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.057278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 316/640] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:43.058652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c35835-6262-4a00-8b26-32907425abf7 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.065466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 325/641] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:43.066562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9efd2-ce7e-43ee-b1ac-cc699a6f60de None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.157552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c35835-6262-4a00-8b26-32907425abf7 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.167139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9efd2-ce7e-43ee-b1ac-cc699a6f60de None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.191045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9b19b-bc67-4629-9e12-3954c09a3872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.191926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9b19b-bc67-4629-9e12-3954c09a3872 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.192191 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9b19b-bc67-4629-9e12-3954c09a3872 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.192476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9b19b-bc67-4629-9e12-3954c09a3872 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.199834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9b19b-bc67-4629-9e12-3954c09a3872 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.200702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc5ee9-cf49-4d4c-a9d1-2aececa6ea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.201341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9b19b-bc67-4629-9e12-3954c09a3872 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.201442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5ee9-cf49-4d4c-a9d1-2aececa6ea56 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.201698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5ee9-cf49-4d4c-a9d1-2aececa6ea56 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.201911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc5ee9-cf49-4d4c-a9d1-2aececa6ea56 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.202763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc5ee9-cf49-4d4c-a9d1-2aececa6ea56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:43.203072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc5ee9-cf49-4d4c-a9d1-2aececa6ea56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.204508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc5ee9-cf49-4d4c-a9d1-2aececa6ea56 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.214630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-00a9b19b-bc67-4629-9e12-3954c09a3872 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:39:43.220828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 317/642] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:43.220828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9b19b-bc67-4629-9e12-3954c09a3872 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.225210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 326/643] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Oct 28 19:39:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:43.229923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc5ee9-cf49-4d4c-a9d1-2aececa6ea56 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.319213 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9b19b-bc67-4629-9e12-3954c09a3872 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.324734 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc5ee9-cf49-4d4c-a9d1-2aececa6ea56 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.352002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770e7b0-ee8d-48ff-8446-915a3469ddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.353154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e7b0-ee8d-48ff-8446-915a3469ddc0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.353682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e7b0-ee8d-48ff-8446-915a3469ddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.354187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e7b0-ee8d-48ff-8446-915a3469ddc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.357134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb8eca-51f8-448f-8849-809a97071f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.357919 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb8eca-51f8-448f-8849-809a97071f5e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.358234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb8eca-51f8-448f-8849-809a97071f5e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.358506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb8eca-51f8-448f-8849-809a97071f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.366024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770e7b0-ee8d-48ff-8446-915a3469ddc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.367649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770e7b0-ee8d-48ff-8446-915a3469ddc0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.368201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb8eca-51f8-448f-8849-809a97071f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.369770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb8eca-51f8-448f-8849-809a97071f5e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.384275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-1770e7b0-ee8d-48ff-8446-915a3469ddc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:43.385937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 318/644] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:43.386051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-01eb8eca-51f8-448f-8849-809a97071f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:43.386999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770e7b0-ee8d-48ff-8446-915a3469ddc0 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.390115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 327/645] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:43.390115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb8eca-51f8-448f-8849-809a97071f5e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.484140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb8eca-51f8-448f-8849-809a97071f5e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.489699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770e7b0-ee8d-48ff-8446-915a3469ddc0 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.516569 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276211c-c725-445f-b6a1-1dbad4ce3d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.517221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276211c-c725-445f-b6a1-1dbad4ce3d55 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.517501 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276211c-c725-445f-b6a1-1dbad4ce3d55 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.517778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276211c-c725-445f-b6a1-1dbad4ce3d55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.523311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dcbca-b577-44c8-8aa1-1ce8a614ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.524145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dcbca-b577-44c8-8aa1-1ce8a614ac7b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.524567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dcbca-b577-44c8-8aa1-1ce8a614ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.524980 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dcbca-b577-44c8-8aa1-1ce8a614ac7b None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.526431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dcbca-b577-44c8-8aa1-1ce8a614ac7b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:43.526897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dcbca-b577-44c8-8aa1-1ce8a614ac7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.528484 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dcbca-b577-44c8-8aa1-1ce8a614ac7b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.546887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 319/646] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Oct 28 19:39:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:43.547863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dcbca-b577-44c8-8aa1-1ce8a614ac7b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.587918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276211c-c725-445f-b6a1-1dbad4ce3d55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.589311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276211c-c725-445f-b6a1-1dbad4ce3d55 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.650405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dcbca-b577-44c8-8aa1-1ce8a614ac7b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.685004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c1e3b-9fa1-4176-95be-cde5bc50d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.685769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c1e3b-9fa1-4176-95be-cde5bc50d774 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.686145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c1e3b-9fa1-4176-95be-cde5bc50d774 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.686423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c1e3b-9fa1-4176-95be-cde5bc50d774 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.687150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c1e3b-9fa1-4176-95be-cde5bc50d774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:43.687451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c1e3b-9fa1-4176-95be-cde5bc50d774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.688822 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c1e3b-9fa1-4176-95be-cde5bc50d774 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.694567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 328/647] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:43.694567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276211c-c725-445f-b6a1-1dbad4ce3d55 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.709588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 320/648] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:43.710506 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c1e3b-9fa1-4176-95be-cde5bc50d774 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.784729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276211c-c725-445f-b6a1-1dbad4ce3d55 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.810683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c1e3b-9fa1-4176-95be-cde5bc50d774 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.817414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984d8bb-aa5c-4914-9215-e96ae352a6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.818603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d8bb-aa5c-4914-9215-e96ae352a6f4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.818948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d8bb-aa5c-4914-9215-e96ae352a6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.819282 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d8bb-aa5c-4914-9215-e96ae352a6f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.820491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984d8bb-aa5c-4914-9215-e96ae352a6f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:43.821162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984d8bb-aa5c-4914-9215-e96ae352a6f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.822917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984d8bb-aa5c-4914-9215-e96ae352a6f4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.841951 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 329/649] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:43.841951 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984d8bb-aa5c-4914-9215-e96ae352a6f4 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:43.844790 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109ffc-b578-42d1-824d-1e51394400a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.845449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ffc-b578-42d1-824d-1e51394400a9 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.845725 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ffc-b578-42d1-824d-1e51394400a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.846002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ffc-b578-42d1-824d-1e51394400a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.917116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf109ffc-b578-42d1-824d-1e51394400a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.918661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf109ffc-b578-42d1-824d-1e51394400a9 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:43.939351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984d8bb-aa5c-4914-9215-e96ae352a6f4 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:43.971044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79a2d2-0bf4-47d6-add3-6ace5031ae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:43.971881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a2d2-0bf4-47d6-add3-6ace5031ae98 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:43.972159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a2d2-0bf4-47d6-add3-6ace5031ae98 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:43.972428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a2d2-0bf4-47d6-add3-6ace5031ae98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:43.984081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79a2d2-0bf4-47d6-add3-6ace5031ae98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:43.985573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79a2d2-0bf4-47d6-add3-6ace5031ae98 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.002852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-0a79a2d2-0bf4-47d6-add3-6ace5031ae98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:44.008784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 330/650] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:44.008784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79a2d2-0bf4-47d6-add3-6ace5031ae98 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.021318 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 321/651] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:44.021318 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109ffc-b578-42d1-824d-1e51394400a9 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.111683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79a2d2-0bf4-47d6-add3-6ace5031ae98 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:44.112202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109ffc-b578-42d1-824d-1e51394400a9 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:44.143355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf9488-39b0-4479-ba68-25b197837083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:44.143603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d0b81-f2bb-4605-9268-71964b893d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:44.144167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9488-39b0-4479-ba68-25b197837083 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.144328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d0b81-f2bb-4605-9268-71964b893d69 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.144473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9488-39b0-4479-ba68-25b197837083 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.144570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d0b81-f2bb-4605-9268-71964b893d69 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.144724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9488-39b0-4479-ba68-25b197837083 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.144861 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d0b81-f2bb-4605-9268-71964b893d69 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.151857 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d0b81-f2bb-4605-9268-71964b893d69 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:44.152212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf9488-39b0-4479-ba68-25b197837083 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:44.153295 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d0b81-f2bb-4605-9268-71964b893d69 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.153716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf9488-39b0-4479-ba68-25b197837083 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.166842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-452d0b81-f2bb-4605-9268-71964b893d69 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:39:44.166984 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-9ccf9488-39b0-4479-ba68-25b197837083 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:39:44.172711 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 322/652] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:44.172858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 331/653] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:44.172858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf9488-39b0-4479-ba68-25b197837083 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.173490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d0b81-f2bb-4605-9268-71964b893d69 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.268736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d0b81-f2bb-4605-9268-71964b893d69 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:44.268943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf9488-39b0-4479-ba68-25b197837083 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:44.301580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516b43d-bb96-4828-b939-577eadabdfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:44.301826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8bd58-cc41-4da3-aa47-cadd72d74721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:44.302285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b43d-bb96-4828-b939-577eadabdfa0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.302470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8bd58-cc41-4da3-aa47-cadd72d74721 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.302563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b43d-bb96-4828-b939-577eadabdfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.302729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8bd58-cc41-4da3-aa47-cadd72d74721 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.302815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b43d-bb96-4828-b939-577eadabdfa0 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.303008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8bd58-cc41-4da3-aa47-cadd72d74721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.303560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516b43d-bb96-4828-b939-577eadabdfa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:44.303815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516b43d-bb96-4828-b939-577eadabdfa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:44.305186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516b43d-bb96-4828-b939-577eadabdfa0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.313420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8bd58-cc41-4da3-aa47-cadd72d74721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:44.314921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8bd58-cc41-4da3-aa47-cadd72d74721 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.322394 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 323/654] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:44.322394 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516b43d-bb96-4828-b939-577eadabdfa0 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.338641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-7fd8bd58-cc41-4da3-aa47-cadd72d74721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:44.339865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 332/655] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:44.340639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8bd58-cc41-4da3-aa47-cadd72d74721 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.414882 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516b43d-bb96-4828-b939-577eadabdfa0 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:44.439518 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8bd58-cc41-4da3-aa47-cadd72d74721 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:44.448173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8babd-12c4-428e-a919-cc3b3026f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:44.448847 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8babd-12c4-428e-a919-cc3b3026f442 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.449121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8babd-12c4-428e-a919-cc3b3026f442 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.449394 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8babd-12c4-428e-a919-cc3b3026f442 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.450259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8babd-12c4-428e-a919-cc3b3026f442 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:44.450565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8babd-12c4-428e-a919-cc3b3026f442 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:44.452005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8babd-12c4-428e-a919-cc3b3026f442 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.468374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 324/656] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:44.469163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8babd-12c4-428e-a919-cc3b3026f442 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.471399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2a177-24a0-46cb-b5a9-9ef4b3c9dd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:44.472086 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2a177-24a0-46cb-b5a9-9ef4b3c9dd0c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.472345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2a177-24a0-46cb-b5a9-9ef4b3c9dd0c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.472614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2a177-24a0-46cb-b5a9-9ef4b3c9dd0c None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.473524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2a177-24a0-46cb-b5a9-9ef4b3c9dd0c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:44.473821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2a177-24a0-46cb-b5a9-9ef4b3c9dd0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:44.475294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2a177-24a0-46cb-b5a9-9ef4b3c9dd0c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.491824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 333/657] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:44.493065 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291ec1b-ae4e-475a-a5c6-9ffcb1c190ae None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.493340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291ec1b-ae4e-475a-a5c6-9ffcb1c190ae None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.493599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291ec1b-ae4e-475a-a5c6-9ffcb1c190ae None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.496589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 334/658] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:44.496589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291ec1b-ae4e-475a-a5c6-9ffcb1c190ae None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.564015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8babd-12c4-428e-a919-cc3b3026f442 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:44.590818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291ec1b-ae4e-475a-a5c6-9ffcb1c190ae None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:44.595548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa697c-7299-4414-8e46-2c70aba89f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:44.596347 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa697c-7299-4414-8e46-2c70aba89f43 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.596619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa697c-7299-4414-8e46-2c70aba89f43 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.596854 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa697c-7299-4414-8e46-2c70aba89f43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.603345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa697c-7299-4414-8e46-2c70aba89f43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:44.604799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa697c-7299-4414-8e46-2c70aba89f43 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.617561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-21fa697c-7299-4414-8e46-2c70aba89f43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:44.618774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 325/659] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:44.619533 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa697c-7299-4414-8e46-2c70aba89f43 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.627809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f7336-b7e4-46e6-bfeb-511b7e061768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:44.628491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f7336-b7e4-46e6-bfeb-511b7e061768 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.628747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f7336-b7e4-46e6-bfeb-511b7e061768 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.629017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f7336-b7e4-46e6-bfeb-511b7e061768 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.629774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f7336-b7e4-46e6-bfeb-511b7e061768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:44.630072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f7336-b7e4-46e6-bfeb-511b7e061768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:44.631471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f7336-b7e4-46e6-bfeb-511b7e061768 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.642646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 335/660] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:44.643418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f7336-b7e4-46e6-bfeb-511b7e061768 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.714540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa697c-7299-4414-8e46-2c70aba89f43 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:44.736685 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f7336-b7e4-46e6-bfeb-511b7e061768 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:44.745917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d52b4-d5bf-4dc4-ad3a-33295204c767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:44.746575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d52b4-d5bf-4dc4-ad3a-33295204c767 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.746859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d52b4-d5bf-4dc4-ad3a-33295204c767 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.747131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d52b4-d5bf-4dc4-ad3a-33295204c767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.769493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cef62-0265-45cb-8609-dc969dcbaa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:44.770258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cef62-0265-45cb-8609-dc969dcbaa8a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.770541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cef62-0265-45cb-8609-dc969dcbaa8a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.770810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cef62-0265-45cb-8609-dc969dcbaa8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.812238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d52b4-d5bf-4dc4-ad3a-33295204c767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:44.813703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d52b4-d5bf-4dc4-ad3a-33295204c767 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.833908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cef62-0265-45cb-8609-dc969dcbaa8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:44.835391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cef62-0265-45cb-8609-dc969dcbaa8a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:44.906733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 326/661] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:44.908008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d09ab-5553-4257-bd4c-d1fdf0990122 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:44.908293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d09ab-5553-4257-bd4c-d1fdf0990122 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:44.908544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d09ab-5553-4257-bd4c-d1fdf0990122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:44.924330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-442d09ab-5553-4257-bd4c-d1fdf0990122 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:44.925479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-442d09ab-5553-4257-bd4c-d1fdf0990122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:44.931321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 336/662] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:44.932151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cef62-0265-45cb-8609-dc969dcbaa8a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:44.989203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 327/663] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:44.990045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d09ab-5553-4257-bd4c-d1fdf0990122 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.025614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cef62-0265-45cb-8609-dc969dcbaa8a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.059188 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53c125-e0e7-4cb6-a96d-a4a5e9e1ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.059843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53c125-e0e7-4cb6-a96d-a4a5e9e1ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.060126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53c125-e0e7-4cb6-a96d-a4a5e9e1ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.060396 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53c125-e0e7-4cb6-a96d-a4a5e9e1ebe9 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.061173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53c125-e0e7-4cb6-a96d-a4a5e9e1ebe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:45.061476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53c125-e0e7-4cb6-a96d-a4a5e9e1ebe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.062966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53c125-e0e7-4cb6-a96d-a4a5e9e1ebe9 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.074139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 337/664] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:45.074853 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53c125-e0e7-4cb6-a96d-a4a5e9e1ebe9 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.083634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d09ab-5553-4257-bd4c-d1fdf0990122 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.115701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0404c-a776-420d-9f2c-70e1e233ec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.116498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0404c-a776-420d-9f2c-70e1e233ec69 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.116781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0404c-a776-420d-9f2c-70e1e233ec69 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.117051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0404c-a776-420d-9f2c-70e1e233ec69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.123617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0404c-a776-420d-9f2c-70e1e233ec69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.125071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0404c-a776-420d-9f2c-70e1e233ec69 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.137887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-76d0404c-a776-420d-9f2c-70e1e233ec69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:45.139118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 328/665] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:45.139842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0404c-a776-420d-9f2c-70e1e233ec69 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.168610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53c125-e0e7-4cb6-a96d-a4a5e9e1ebe9 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.200651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb5835-7748-457e-b418-3da379191edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.201447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb5835-7748-457e-b418-3da379191edc None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.201721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb5835-7748-457e-b418-3da379191edc None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.201989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb5835-7748-457e-b418-3da379191edc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.212274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb5835-7748-457e-b418-3da379191edc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.213708 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb5835-7748-457e-b418-3da379191edc None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.229419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-1ccb5835-7748-457e-b418-3da379191edc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:45.230660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 338/666] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:45.231407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb5835-7748-457e-b418-3da379191edc None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.238376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0404c-a776-420d-9f2c-70e1e233ec69 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.269522 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a3413-ae98-4d0c-a1e3-5286a27ff36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.270392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3413-ae98-4d0c-a1e3-5286a27ff36f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.270670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3413-ae98-4d0c-a1e3-5286a27ff36f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.270940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3413-ae98-4d0c-a1e3-5286a27ff36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.280972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a3413-ae98-4d0c-a1e3-5286a27ff36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.282443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a3413-ae98-4d0c-a1e3-5286a27ff36f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.298094 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-4e6a3413-ae98-4d0c-a1e3-5286a27ff36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:45.299266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 329/667] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:45.300034 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a3413-ae98-4d0c-a1e3-5286a27ff36f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.326690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb5835-7748-457e-b418-3da379191edc None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.357011 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278302d-2f7b-488d-8bf7-eb5fb9326d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.357806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278302d-2f7b-488d-8bf7-eb5fb9326d31 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.358105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278302d-2f7b-488d-8bf7-eb5fb9326d31 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.358363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278302d-2f7b-488d-8bf7-eb5fb9326d31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.368256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278302d-2f7b-488d-8bf7-eb5fb9326d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:45.375297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-8278302d-2f7b-488d-8bf7-eb5fb9326d31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:45.376439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 339/668] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:45.377182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278302d-2f7b-488d-8bf7-eb5fb9326d31 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.395093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a3413-ae98-4d0c-a1e3-5286a27ff36f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.426571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b88c1-e283-4281-9707-0603a3ed3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.427214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b88c1-e283-4281-9707-0603a3ed3154 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.427491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b88c1-e283-4281-9707-0603a3ed3154 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.427756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b88c1-e283-4281-9707-0603a3ed3154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.428584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b88c1-e283-4281-9707-0603a3ed3154 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=be7be85d70b64273b7904082ee2ba848) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:45.428894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b88c1-e283-4281-9707-0603a3ed3154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.430328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b88c1-e283-4281-9707-0603a3ed3154 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.435890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 330/669] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/role_assignments?user.id=be7be85d70b64273b7904082ee2ba848&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:45.436638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b88c1-e283-4281-9707-0603a3ed3154 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.475805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278302d-2f7b-488d-8bf7-eb5fb9326d31 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.509934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6deb742-fe5e-4b41-9e5d-d109625f7ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.510620 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6deb742-fe5e-4b41-9e5d-d109625f7ef2 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.510888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6deb742-fe5e-4b41-9e5d-d109625f7ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.511159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6deb742-fe5e-4b41-9e5d-d109625f7ef2 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.511965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6deb742-fe5e-4b41-9e5d-d109625f7ef2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:45.512271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6deb742-fe5e-4b41-9e5d-d109625f7ef2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.513725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6deb742-fe5e-4b41-9e5d-d109625f7ef2 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.526896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 340/670] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:45.527676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6deb742-fe5e-4b41-9e5d-d109625f7ef2 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.552056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b88c1-e283-4281-9707-0603a3ed3154 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.586354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409a402-5e35-4be0-964e-cafbbe92a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.587027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409a402-5e35-4be0-964e-cafbbe92a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.587304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409a402-5e35-4be0-964e-cafbbe92a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.587573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409a402-5e35-4be0-964e-cafbbe92a8e4 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.588298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409a402-5e35-4be0-964e-cafbbe92a8e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:45.588599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409a402-5e35-4be0-964e-cafbbe92a8e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.590035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409a402-5e35-4be0-964e-cafbbe92a8e4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.607135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 331/671] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:45.607135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409a402-5e35-4be0-964e-cafbbe92a8e4 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.636326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6deb742-fe5e-4b41-9e5d-d109625f7ef2 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.673932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b08d9-9363-4ec4-b1a9-d80d322ff083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.674641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b08d9-9363-4ec4-b1a9-d80d322ff083 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.674921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b08d9-9363-4ec4-b1a9-d80d322ff083 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.675198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b08d9-9363-4ec4-b1a9-d80d322ff083 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.676345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b08d9-9363-4ec4-b1a9-d80d322ff083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:45.676656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b08d9-9363-4ec4-b1a9-d80d322ff083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.678034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b08d9-9363-4ec4-b1a9-d80d322ff083 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.694451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 341/672] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:45.695380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b08d9-9363-4ec4-b1a9-d80d322ff083 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.715799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409a402-5e35-4be0-964e-cafbbe92a8e4 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.748777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ce020-1292-4eff-901d-dc936d817d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.749460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ce020-1292-4eff-901d-dc936d817d76 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.749740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ce020-1292-4eff-901d-dc936d817d76 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.750012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ce020-1292-4eff-901d-dc936d817d76 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.750788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ce020-1292-4eff-901d-dc936d817d76 None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:45.751090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ce020-1292-4eff-901d-dc936d817d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.752462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ce020-1292-4eff-901d-dc936d817d76 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.760328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 332/673] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:45.761250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ce020-1292-4eff-901d-dc936d817d76 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.791903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b08d9-9363-4ec4-b1a9-d80d322ff083 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.824301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddbe25-ca17-48a0-9e75-f85dd4dd8bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.824963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddbe25-ca17-48a0-9e75-f85dd4dd8bd7 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.825243 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddbe25-ca17-48a0-9e75-f85dd4dd8bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.825592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddbe25-ca17-48a0-9e75-f85dd4dd8bd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.826467 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddbe25-ca17-48a0-9e75-f85dd4dd8bd7 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=ba2e2211f5d14ebcbd0221278248b868) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:45.827168 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddbe25-ca17-48a0-9e75-f85dd4dd8bd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.828215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddbe25-ca17-48a0-9e75-f85dd4dd8bd7 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.838418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 342/674] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/role_assignments?user.id=ba2e2211f5d14ebcbd0221278248b868&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:45.838418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddbe25-ca17-48a0-9e75-f85dd4dd8bd7 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.870762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ce020-1292-4eff-901d-dc936d817d76 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.905546 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8f378-4301-42f2-a46c-a6eccda03bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.906495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8f378-4301-42f2-a46c-a6eccda03bd1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.906838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8f378-4301-42f2-a46c-a6eccda03bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.907175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8f378-4301-42f2-a46c-a6eccda03bd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.915102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8f378-4301-42f2-a46c-a6eccda03bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.916764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8f378-4301-42f2-a46c-a6eccda03bd1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:45.932536 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-e2d8f378-4301-42f2-a46c-a6eccda03bd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:45.934306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 333/675] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:45.935240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8f378-4301-42f2-a46c-a6eccda03bd1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:45.944745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddbe25-ca17-48a0-9e75-f85dd4dd8bd7 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:45.980606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba84ea9-7415-4883-892e-4029bac95f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:45.981666 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84ea9-7415-4883-892e-4029bac95f44 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:45.981666 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84ea9-7415-4883-892e-4029bac95f44 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:45.981950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84ea9-7415-4883-892e-4029bac95f44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:45.989460 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba84ea9-7415-4883-892e-4029bac95f44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:45.991167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba84ea9-7415-4883-892e-4029bac95f44 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:46.005600 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-2ba84ea9-7415-4883-892e-4029bac95f44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:46.011800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 343/676] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:46.011800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba84ea9-7415-4883-892e-4029bac95f44 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:46.049413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8f378-4301-42f2-a46c-a6eccda03bd1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:46.085396 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e9435-e978-488a-8a03-eea44660b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:46.086236 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9435-e978-488a-8a03-eea44660b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:46.086509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9435-e978-488a-8a03-eea44660b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:46.086773 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9435-e978-488a-8a03-eea44660b5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:46.099957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e9435-e978-488a-8a03-eea44660b5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:46.101432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e9435-e978-488a-8a03-eea44660b5f1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:46.113954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba84ea9-7415-4883-892e-4029bac95f44 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:46.117837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-4e8e9435-e978-488a-8a03-eea44660b5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:46.119277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 334/677] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:46.122136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e9435-e978-488a-8a03-eea44660b5f1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:46.149349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231d94c-ff0a-46fc-afc6-656d20a617a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:46.150022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231d94c-ff0a-46fc-afc6-656d20a617a6 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:46.150334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231d94c-ff0a-46fc-afc6-656d20a617a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:46.150609 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231d94c-ff0a-46fc-afc6-656d20a617a6 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:46.151407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231d94c-ff0a-46fc-afc6-656d20a617a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:46.151717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231d94c-ff0a-46fc-afc6-656d20a617a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:46.153167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231d94c-ff0a-46fc-afc6-656d20a617a6 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:46.165235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 344/678] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:46.166091 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231d94c-ff0a-46fc-afc6-656d20a617a6 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:46.216880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e9435-e978-488a-8a03-eea44660b5f1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:46.249636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90734c-7ced-4df4-9a95-892cd73541a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:46.250329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90734c-7ced-4df4-9a95-892cd73541a6 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:46.250607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90734c-7ced-4df4-9a95-892cd73541a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:46.250881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90734c-7ced-4df4-9a95-892cd73541a6 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:46.251653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90734c-7ced-4df4-9a95-892cd73541a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:46.251951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90734c-7ced-4df4-9a95-892cd73541a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:46.253397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90734c-7ced-4df4-9a95-892cd73541a6 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:46.264345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231d94c-ff0a-46fc-afc6-656d20a617a6 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:46.265775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 335/679] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:46.266647 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90734c-7ced-4df4-9a95-892cd73541a6 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:46.305055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31b457-47cd-4fc2-9942-35f6960edb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:46.305687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31b457-47cd-4fc2-9942-35f6960edb22 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:46.305965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31b457-47cd-4fc2-9942-35f6960edb22 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:46.306281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31b457-47cd-4fc2-9942-35f6960edb22 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:46.307056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31b457-47cd-4fc2-9942-35f6960edb22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:46.307357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31b457-47cd-4fc2-9942-35f6960edb22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:46.308730 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31b457-47cd-4fc2-9942-35f6960edb22 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:46.322115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 345/680] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:46.322973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31b457-47cd-4fc2-9942-35f6960edb22 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:46.389690 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90734c-7ced-4df4-9a95-892cd73541a6 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:46.421339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31b457-47cd-4fc2-9942-35f6960edb22 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:46.431770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f71a19-f263-4b42-a318-89a8fa0b8b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:46.432755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f71a19-f263-4b42-a318-89a8fa0b8b40 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:46.433304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f71a19-f263-4b42-a318-89a8fa0b8b40 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:46.433585 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f71a19-f263-4b42-a318-89a8fa0b8b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:46.434457 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f71a19-f263-4b42-a318-89a8fa0b8b40 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=f94515985e244af29f47a49c0dd415ec) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:46.434938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f71a19-f263-4b42-a318-89a8fa0b8b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:46.437045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f71a19-f263-4b42-a318-89a8fa0b8b40 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:46.444804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 336/681] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:46 2022] GET /identity/v3/role_assignments?user.id=f94515985e244af29f47a49c0dd415ec&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:46.445674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f71a19-f263-4b42-a318-89a8fa0b8b40 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:46.485691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e489-5a26-4500-9c4d-d7e68745234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:46.486399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e489-5a26-4500-9c4d-d7e68745234a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:46.486677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e489-5a26-4500-9c4d-d7e68745234a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:46.486944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e489-5a26-4500-9c4d-d7e68745234a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:46.487785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9e489-5a26-4500-9c4d-d7e68745234a None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=444a88451fbd4814b6d81023e68b54a7) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:46.488088 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9e489-5a26-4500-9c4d-d7e68745234a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:46.489705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9e489-5a26-4500-9c4d-d7e68745234a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:46.509038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 346/682] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:46 2022] GET /identity/v3/role_assignments?user.id=444a88451fbd4814b6d81023e68b54a7&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:46.603923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f71a19-f263-4b42-a318-89a8fa0b8b40 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:46.659856 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51752fe1-ddac-4a1c-aab4-1a48a8a33014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:46.660796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752fe1-ddac-4a1c-aab4-1a48a8a33014 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:46.661083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752fe1-ddac-4a1c-aab4-1a48a8a33014 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:46.661437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752fe1-ddac-4a1c-aab4-1a48a8a33014 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:46.669910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51752fe1-ddac-4a1c-aab4-1a48a8a33014 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:46.671452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51752fe1-ddac-4a1c-aab4-1a48a8a33014 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:46.696255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-51752fe1-ddac-4a1c-aab4-1a48a8a33014 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:39:46.698273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 337/683] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:46.703736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e489-5a26-4500-9c4d-d7e68745234a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:46.812575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e489-5a26-4500-9c4d-d7e68745234a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:46.848689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322154b-3c85-4f84-a499-be08e9f06278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:46.849762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322154b-3c85-4f84-a499-be08e9f06278 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:46.850036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322154b-3c85-4f84-a499-be08e9f06278 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:46.850338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322154b-3c85-4f84-a499-be08e9f06278 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:46.851175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322154b-3c85-4f84-a499-be08e9f06278 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:46.851472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322154b-3c85-4f84-a499-be08e9f06278 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:46.852911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322154b-3c85-4f84-a499-be08e9f06278 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:46.871643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 347/684] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Oct 28 19:39:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:46.877420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51752fe1-ddac-4a1c-aab4-1a48a8a33014 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:46.984110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51752fe1-ddac-4a1c-aab4-1a48a8a33014 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:47.017483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c3dab-2612-4c34-8946-1aae932eb141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:47.018554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c3dab-2612-4c34-8946-1aae932eb141 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:47.019030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c3dab-2612-4c34-8946-1aae932eb141 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:47.019490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c3dab-2612-4c34-8946-1aae932eb141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:47.087079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c3dab-2612-4c34-8946-1aae932eb141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:47.088946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c3dab-2612-4c34-8946-1aae932eb141 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:47.189617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 338/685] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:39:47.196225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322154b-3c85-4f84-a499-be08e9f06278 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:47.294109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322154b-3c85-4f84-a499-be08e9f06278 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:47.328582 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b222f0-24fd-402b-a8bd-abeb76643f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:47.329772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b222f0-24fd-402b-a8bd-abeb76643f61 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:47.330314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b222f0-24fd-402b-a8bd-abeb76643f61 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:47.330772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b222f0-24fd-402b-a8bd-abeb76643f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:47.341032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b222f0-24fd-402b-a8bd-abeb76643f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:47.342793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b222f0-24fd-402b-a8bd-abeb76643f61 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:47.359937 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c2b222f0-24fd-402b-a8bd-abeb76643f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:47.361726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 348/686] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:47.367750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c3dab-2612-4c34-8946-1aae932eb141 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:47.464332 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c3dab-2612-4c34-8946-1aae932eb141 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:47.497448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af61128-57f8-4fe2-94fa-66a277270cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:47.498498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af61128-57f8-4fe2-94fa-66a277270cb4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:47.498974 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af61128-57f8-4fe2-94fa-66a277270cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:47.499452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af61128-57f8-4fe2-94fa-66a277270cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:47.500354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af61128-57f8-4fe2-94fa-66a277270cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:47.500863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af61128-57f8-4fe2-94fa-66a277270cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:47.502472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af61128-57f8-4fe2-94fa-66a277270cb4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:47.514451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 339/687] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:47.520264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b222f0-24fd-402b-a8bd-abeb76643f61 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:47.620088 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b222f0-24fd-402b-a8bd-abeb76643f61 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:47.659781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919b644-dfa2-418e-9baf-60aa0973da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:47.660646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919b644-dfa2-418e-9baf-60aa0973da63 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:47.660939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919b644-dfa2-418e-9baf-60aa0973da63 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:47.661200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919b644-dfa2-418e-9baf-60aa0973da63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:47.668604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919b644-dfa2-418e-9baf-60aa0973da63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:47.670070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919b644-dfa2-418e-9baf-60aa0973da63 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:47.687596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-d919b644-dfa2-418e-9baf-60aa0973da63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:47.689155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 349/688] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:47.694992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af61128-57f8-4fe2-94fa-66a277270cb4 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:47.820878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af61128-57f8-4fe2-94fa-66a277270cb4 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:47.868160 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b265f1-3397-4339-8bf8-e3c00272f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:47.868838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b265f1-3397-4339-8bf8-e3c00272f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:47.869114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b265f1-3397-4339-8bf8-e3c00272f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:47.869383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b265f1-3397-4339-8bf8-e3c00272f5b3 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:47.870215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b265f1-3397-4339-8bf8-e3c00272f5b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:47.870518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b265f1-3397-4339-8bf8-e3c00272f5b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:47.871945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b265f1-3397-4339-8bf8-e3c00272f5b3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:47.889258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 340/689] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:47.894953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919b644-dfa2-418e-9baf-60aa0973da63 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:48.006487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919b644-dfa2-418e-9baf-60aa0973da63 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:48.045170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1f53-d81d-4822-9188-dca628d8ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:48.045846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1f53-d81d-4822-9188-dca628d8ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:48.046164 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1f53-d81d-4822-9188-dca628d8ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:48.046442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1f53-d81d-4822-9188-dca628d8ddd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:48.047281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb1f53-d81d-4822-9188-dca628d8ddd6 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=720ff448eaea42aaa7e399e5b950b01e) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:48.047593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb1f53-d81d-4822-9188-dca628d8ddd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:48.049039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb1f53-d81d-4822-9188-dca628d8ddd6 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:48.056110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 350/690] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:47 2022] GET /identity/v3/role_assignments?user.id=720ff448eaea42aaa7e399e5b950b01e&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:48.158163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8f261-e2d3-43c3-ae13-80556ff7c053 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:48.158336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8f261-e2d3-43c3-ae13-80556ff7c053 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:48.158621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8f261-e2d3-43c3-ae13-80556ff7c053 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:48.160882 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 341/691] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:48.166808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cbe6c-f1bd-4eaa-a05b-17c102da63a4 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:48.167112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cbe6c-f1bd-4eaa-a05b-17c102da63a4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:48.167368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cbe6c-f1bd-4eaa-a05b-17c102da63a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:48.194761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-422cbe6c-f1bd-4eaa-a05b-17c102da63a4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:48.195992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-422cbe6c-f1bd-4eaa-a05b-17c102da63a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:48.283862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 351/692] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:48.322109 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8f261-e2d3-43c3-ae13-80556ff7c053 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:48.434026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8f261-e2d3-43c3-ae13-80556ff7c053 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:48.472238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d319f20-5f84-464a-bd6e-cef7d631b3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:48.473130 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319f20-5f84-464a-bd6e-cef7d631b3ea None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:48.473409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319f20-5f84-464a-bd6e-cef7d631b3ea None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:48.473682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319f20-5f84-464a-bd6e-cef7d631b3ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:48.485625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d319f20-5f84-464a-bd6e-cef7d631b3ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:48.493000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-8d319f20-5f84-464a-bd6e-cef7d631b3ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:39:48.494640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 342/693] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:48.501706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cbe6c-f1bd-4eaa-a05b-17c102da63a4 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:48.551471 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5d77-5788-498f-86bd-9bbc993e6c81 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:48.552115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5d77-5788-498f-86bd-9bbc993e6c81 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:48.552595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5d77-5788-498f-86bd-9bbc993e6c81 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:48.554611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 343/694] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:39:48.561179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af8b34-3caf-48c9-9854-29d069ca036f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:48.561708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af8b34-3caf-48c9-9854-29d069ca036f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:48.562199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af8b34-3caf-48c9-9854-29d069ca036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:48.582566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d5af8b34-3caf-48c9-9854-29d069ca036f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:48.584064 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d5af8b34-3caf-48c9-9854-29d069ca036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:48.613521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cbe6c-f1bd-4eaa-a05b-17c102da63a4 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:48.657210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae480df-e2e0-429f-9272-f6dc3ee7b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:48.657896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae480df-e2e0-429f-9272-f6dc3ee7b197 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:48.658197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae480df-e2e0-429f-9272-f6dc3ee7b197 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:48.658469 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae480df-e2e0-429f-9272-f6dc3ee7b197 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:48.659246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae480df-e2e0-429f-9272-f6dc3ee7b197 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:48.659708 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae480df-e2e0-429f-9272-f6dc3ee7b197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:48.661163 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae480df-e2e0-429f-9272-f6dc3ee7b197 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:48.670219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 352/695] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:48.676370 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae480df-e2e0-429f-9272-f6dc3ee7b197 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:48.682942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 344/696] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:48.707687 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af8b34-3caf-48c9-9854-29d069ca036f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:48.854130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae480df-e2e0-429f-9272-f6dc3ee7b197 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:48.874912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af8b34-3caf-48c9-9854-29d069ca036f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:48.891693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90b3a7-d155-4978-8da9-683b99af6cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:48.892499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90b3a7-d155-4978-8da9-683b99af6cc0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:48.892791 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90b3a7-d155-4978-8da9-683b99af6cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:48.893062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90b3a7-d155-4978-8da9-683b99af6cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:48.915549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90b3a7-d155-4978-8da9-683b99af6cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:48.917701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90b3a7-d155-4978-8da9-683b99af6cc0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:48.919436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de65b48-fdaa-4c39-9132-324d225ac87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:48.920524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65b48-fdaa-4c39-9132-324d225ac87e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:48.921011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65b48-fdaa-4c39-9132-324d225ac87e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:48.921464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65b48-fdaa-4c39-9132-324d225ac87e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:48.922358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de65b48-fdaa-4c39-9132-324d225ac87e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:48.923928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de65b48-fdaa-4c39-9132-324d225ac87e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:48.954109 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-2de65b48-fdaa-4c39-9132-324d225ac87e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:39:48.956025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 345/697] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Oct 28 19:39:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:48.958934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-5e90b3a7-d155-4978-8da9-683b99af6cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:48.965989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de65b48-fdaa-4c39-9132-324d225ac87e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:48.966725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 353/698] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:48.975627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90b3a7-d155-4978-8da9-683b99af6cc0 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:49.108794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de65b48-fdaa-4c39-9132-324d225ac87e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:49.148804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a0064-98e5-429c-b22c-0ad058aacfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:49.149905 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a0064-98e5-429c-b22c-0ad058aacfd1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:49.150392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a0064-98e5-429c-b22c-0ad058aacfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:49.150874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a0064-98e5-429c-b22c-0ad058aacfd1 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:49.151886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a0064-98e5-429c-b22c-0ad058aacfd1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:49.152437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a0064-98e5-429c-b22c-0ad058aacfd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:49.154408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a0064-98e5-429c-b22c-0ad058aacfd1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:49.164670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 346/699] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Oct 28 19:39:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:49.172597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a0064-98e5-429c-b22c-0ad058aacfd1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:49.209954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90b3a7-d155-4978-8da9-683b99af6cc0 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:49.279036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7689d-a870-4263-af93-8fe9e0eaa63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:49.279714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7689d-a870-4263-af93-8fe9e0eaa63a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:49.279990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7689d-a870-4263-af93-8fe9e0eaa63a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:49.280258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7689d-a870-4263-af93-8fe9e0eaa63a None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:49.280983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7689d-a870-4263-af93-8fe9e0eaa63a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:49.281286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7689d-a870-4263-af93-8fe9e0eaa63a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:49.283894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7689d-a870-4263-af93-8fe9e0eaa63a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:49.307682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 354/700] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:49.313646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7689d-a870-4263-af93-8fe9e0eaa63a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:49.345818 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a0064-98e5-429c-b22c-0ad058aacfd1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:49.386352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5adc5c-45c6-49fb-b524-445873ec1ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:49.387191 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5adc5c-45c6-49fb-b524-445873ec1ccf None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:49.387472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5adc5c-45c6-49fb-b524-445873ec1ccf None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:49.388142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5adc5c-45c6-49fb-b524-445873ec1ccf None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:49.389133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5adc5c-45c6-49fb-b524-445873ec1ccf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:49.389441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5adc5c-45c6-49fb-b524-445873ec1ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:49.391298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5adc5c-45c6-49fb-b524-445873ec1ccf None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:49.399069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 347/701] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Oct 28 19:39:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:49.402795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c658374-c9b0-4a02-a5b1-4d10aa67f5e2 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:49.403104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c658374-c9b0-4a02-a5b1-4d10aa67f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:49.403353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c658374-c9b0-4a02-a5b1-4d10aa67f5e2 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:49.410949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 348/702] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:49.412495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2309e6-3c9d-47b5-9c25-07360451b77c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:49.412781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2309e6-3c9d-47b5-9c25-07360451b77c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:49.413051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2309e6-3c9d-47b5-9c25-07360451b77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:49.446386 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0c2309e6-3c9d-47b5-9c25-07360451b77c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:49.447605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0c2309e6-3c9d-47b5-9c25-07360451b77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:49.497904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7689d-a870-4263-af93-8fe9e0eaa63a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:49.566462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b2e31-36dd-479b-ac1c-b53a0dd1e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:49.567367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b2e31-36dd-479b-ac1c-b53a0dd1e9ef None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:49.567652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b2e31-36dd-479b-ac1c-b53a0dd1e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:49.567927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b2e31-36dd-479b-ac1c-b53a0dd1e9ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:49.577552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b2e31-36dd-479b-ac1c-b53a0dd1e9ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:49.579134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b2e31-36dd-479b-ac1c-b53a0dd1e9ef None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:49.580232 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 349/703] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:49.604870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-ec5b2e31-36dd-479b-ac1c-b53a0dd1e9ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:39:49.606495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 355/704] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Oct 28 19:39:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:49.612189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2309e6-3c9d-47b5-9c25-07360451b77c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:49.623715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b2e31-36dd-479b-ac1c-b53a0dd1e9ef None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:49.737358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2309e6-3c9d-47b5-9c25-07360451b77c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:49.738600 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b2e31-36dd-479b-ac1c-b53a0dd1e9ef None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:49.775920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d8c53-0ed8-4a54-89c6-b782775c2ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:49.776668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8c53-0ed8-4a54-89c6-b782775c2ba8 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:49.776938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8c53-0ed8-4a54-89c6-b782775c2ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:49.777213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8c53-0ed8-4a54-89c6-b782775c2ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:49.780437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990a6c-b5b9-41bb-8789-6cdbab16c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:49.781119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990a6c-b5b9-41bb-8789-6cdbab16c237 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:49.781399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990a6c-b5b9-41bb-8789-6cdbab16c237 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:49.781671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990a6c-b5b9-41bb-8789-6cdbab16c237 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:49.782548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd990a6c-b5b9-41bb-8789-6cdbab16c237 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:49.782855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd990a6c-b5b9-41bb-8789-6cdbab16c237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:49.784320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd990a6c-b5b9-41bb-8789-6cdbab16c237 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:49.793258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d8c53-0ed8-4a54-89c6-b782775c2ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:49.795350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d8c53-0ed8-4a54-89c6-b782775c2ba8 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:49.807125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 350/705] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Oct 28 19:39:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:49.813554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990a6c-b5b9-41bb-8789-6cdbab16c237 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:49.825010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-eb9d8c53-0ed8-4a54-89c6-b782775c2ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:49.826638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 356/706] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:49.832956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f302b-69a3-4eef-9dfb-a23e13141daf None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:49.833348 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f302b-69a3-4eef-9dfb-a23e13141daf None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:49.833824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f302b-69a3-4eef-9dfb-a23e13141daf None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:49.838202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 357/707] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:39:49.840193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f302b-69a3-4eef-9dfb-a23e13141daf None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:49.926433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990a6c-b5b9-41bb-8789-6cdbab16c237 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:49.960119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bd839-dd35-41b5-b4b4-5ecab9da6c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:49.960772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bd839-dd35-41b5-b4b4-5ecab9da6c29 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:49.961046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bd839-dd35-41b5-b4b4-5ecab9da6c29 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:49.961315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bd839-dd35-41b5-b4b4-5ecab9da6c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:49.966979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f302b-69a3-4eef-9dfb-a23e13141daf None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:50.007989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395c949-7a90-4dd7-81e5-69e9cc7df981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:50.008668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c949-7a90-4dd7-81e5-69e9cc7df981 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:50.008946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c949-7a90-4dd7-81e5-69e9cc7df981 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:50.009556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c949-7a90-4dd7-81e5-69e9cc7df981 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:50.010302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395c949-7a90-4dd7-81e5-69e9cc7df981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:50.010900 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395c949-7a90-4dd7-81e5-69e9cc7df981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:50.012534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395c949-7a90-4dd7-81e5-69e9cc7df981 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:50.027157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 358/708] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:50.028928 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca9379-dfe8-4919-a647-0aff3a248abb None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:50.029210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca9379-dfe8-4919-a647-0aff3a248abb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:50.029483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca9379-dfe8-4919-a647-0aff3a248abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:50.037794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bd839-dd35-41b5-b4b4-5ecab9da6c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:50.039420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bd839-dd35-41b5-b4b4-5ecab9da6c29 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:50.048427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-cfca9379-dfe8-4919-a647-0aff3a248abb None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:50.049604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-cfca9379-dfe8-4919-a647-0aff3a248abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:50.121751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 359/709] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:50.122652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca9379-dfe8-4919-a647-0aff3a248abb None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:50.159112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 351/710] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:50.160294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bd839-dd35-41b5-b4b4-5ecab9da6c29 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:50.233236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca9379-dfe8-4919-a647-0aff3a248abb None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:50.264962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bd839-dd35-41b5-b4b4-5ecab9da6c29 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:50.265731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef01025-d330-4310-90ef-b7f3d8518ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:50.266442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef01025-d330-4310-90ef-b7f3d8518ad3 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:50.266716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef01025-d330-4310-90ef-b7f3d8518ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:50.267021 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef01025-d330-4310-90ef-b7f3d8518ad3 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:50.267726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef01025-d330-4310-90ef-b7f3d8518ad3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:50.269159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef01025-d330-4310-90ef-b7f3d8518ad3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:50.293379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 360/711] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:39:50 2022] POST /identity/v3/users => generated 254 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:39:50.294428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef01025-d330-4310-90ef-b7f3d8518ad3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:50.301672 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c84d31-5238-432e-b8eb-2bc2bfd41d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:50.302599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c84d31-5238-432e-b8eb-2bc2bfd41d02 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:50.302877 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c84d31-5238-432e-b8eb-2bc2bfd41d02 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:50.303145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c84d31-5238-432e-b8eb-2bc2bfd41d02 None admin] PATH_INFO: `/v3/services/network` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:50.303805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c84d31-5238-432e-b8eb-2bc2bfd41d02 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:50.305200 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c84d31-5238-432e-b8eb-2bc2bfd41d02 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:50.317039 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-95c84d31-5238-432e-b8eb-2bc2bfd41d02 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:39:50.318739 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 352/712] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:50 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:50.326256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c84d31-5238-432e-b8eb-2bc2bfd41d02 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:50.407941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef01025-d330-4310-90ef-b7f3d8518ad3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:50.445530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536af36f-6c85-4d78-a82f-ae8e4c2bccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:50.446414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536af36f-6c85-4d78-a82f-ae8e4c2bccef None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:50.446692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536af36f-6c85-4d78-a82f-ae8e4c2bccef None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:50.447024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536af36f-6c85-4d78-a82f-ae8e4c2bccef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:50.461606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c84d31-5238-432e-b8eb-2bc2bfd41d02 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:50.471564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536af36f-6c85-4d78-a82f-ae8e4c2bccef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:50.473177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536af36f-6c85-4d78-a82f-ae8e4c2bccef None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:50.501937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dae4c8-725f-46b0-a4a1-72c5c7fdfb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:50.503001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae4c8-725f-46b0-a4a1-72c5c7fdfb70 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:50.503471 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae4c8-725f-46b0-a4a1-72c5c7fdfb70 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:50.504037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae4c8-725f-46b0-a4a1-72c5c7fdfb70 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:50.504965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dae4c8-725f-46b0-a4a1-72c5c7fdfb70 None admin] RBAC: Adding query filter params (name=network) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:50.505467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dae4c8-725f-46b0-a4a1-72c5c7fdfb70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:50.507139 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dae4c8-725f-46b0-a4a1-72c5c7fdfb70 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:50.510602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-536af36f-6c85-4d78-a82f-ae8e4c2bccef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:50.513045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 353/714] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:39:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:50.513185 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 361/714] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:50.518276 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536af36f-6c85-4d78-a82f-ae8e4c2bccef None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:50.519403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dae4c8-725f-46b0-a4a1-72c5c7fdfb70 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:50.637352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dae4c8-725f-46b0-a4a1-72c5c7fdfb70 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:50.676644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536af36f-6c85-4d78-a82f-ae8e4c2bccef None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:50.684265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c0d9b-797e-4f18-9e3d-44d9466d1fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:50.684997 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0d9b-797e-4f18-9e3d-44d9466d1fab None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:50.685281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0d9b-797e-4f18-9e3d-44d9466d1fab None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:50.685556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0d9b-797e-4f18-9e3d-44d9466d1fab None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:50.686798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c0d9b-797e-4f18-9e3d-44d9466d1fab None admin] RBAC: Adding query filter params (type=network) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:50.687179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c0d9b-797e-4f18-9e3d-44d9466d1fab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:50.689011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c0d9b-797e-4f18-9e3d-44d9466d1fab None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:50.696296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 354/715] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:39:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:50.720807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89302fa9-d449-4b66-b84b-32f8dba88a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:50.721452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89302fa9-d449-4b66-b84b-32f8dba88a3d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:50.721714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89302fa9-d449-4b66-b84b-32f8dba88a3d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:50.721980 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89302fa9-d449-4b66-b84b-32f8dba88a3d None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:50.722903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89302fa9-d449-4b66-b84b-32f8dba88a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:50.723189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89302fa9-d449-4b66-b84b-32f8dba88a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:50.724711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89302fa9-d449-4b66-b84b-32f8dba88a3d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:50.741254 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 362/716] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:50.746912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c0d9b-797e-4f18-9e3d-44d9466d1fab None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:50.861272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c0d9b-797e-4f18-9e3d-44d9466d1fab None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:50.905484 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f550e89-e817-4512-8fbd-46b7cbf56da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:50.906751 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f550e89-e817-4512-8fbd-46b7cbf56da5 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:50.907237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f550e89-e817-4512-8fbd-46b7cbf56da5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:50.907703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f550e89-e817-4512-8fbd-46b7cbf56da5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:50.915839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f550e89-e817-4512-8fbd-46b7cbf56da5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:50.917655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f550e89-e817-4512-8fbd-46b7cbf56da5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:50.936911 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-6f550e89-e817-4512-8fbd-46b7cbf56da5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:50.938798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 355/717] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:50.951186 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89302fa9-d449-4b66-b84b-32f8dba88a3d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:51.067175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89302fa9-d449-4b66-b84b-32f8dba88a3d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:51.105696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7552f-8231-42e8-889e-f19f0136f063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:51.106402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7552f-8231-42e8-889e-f19f0136f063 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:51.106682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7552f-8231-42e8-889e-f19f0136f063 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:51.106996 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7552f-8231-42e8-889e-f19f0136f063 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:51.107789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7552f-8231-42e8-889e-f19f0136f063 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:51.108092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7552f-8231-42e8-889e-f19f0136f063 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:51.109539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7552f-8231-42e8-889e-f19f0136f063 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:51.121595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 363/718] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:51.127617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f550e89-e817-4512-8fbd-46b7cbf56da5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:51.249107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f550e89-e817-4512-8fbd-46b7cbf56da5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:51.289595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d833a-1710-4bf1-86b7-e7966d801bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:51.290320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d833a-1710-4bf1-86b7-e7966d801bef None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:51.290604 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d833a-1710-4bf1-86b7-e7966d801bef None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:51.290880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d833a-1710-4bf1-86b7-e7966d801bef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:51.291716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d833a-1710-4bf1-86b7-e7966d801bef None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=e91226b635934bfcb949577491791af4, user.id=be7be85d70b64273b7904082ee2ba848) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:51.292025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d833a-1710-4bf1-86b7-e7966d801bef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:51.293464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d833a-1710-4bf1-86b7-e7966d801bef None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:51.299230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 356/719] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:51 2022] GET /identity/v3/role_assignments?user.id=be7be85d70b64273b7904082ee2ba848&scope.project.id=e91226b635934bfcb949577491791af4&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:51.444388 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d993-d438-47cc-8587-429a0dd5baf5 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:51.444723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d993-d438-47cc-8587-429a0dd5baf5 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:51.444942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d993-d438-47cc-8587-429a0dd5baf5 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:51.447125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 364/720] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:51.452926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb66da5-b2ee-4121-a5da-c74b92076a05 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:51.453217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb66da5-b2ee-4121-a5da-c74b92076a05 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:51.453501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb66da5-b2ee-4121-a5da-c74b92076a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:51.476829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-6bb66da5-b2ee-4121-a5da-c74b92076a05 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:51.478144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6bb66da5-b2ee-4121-a5da-c74b92076a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:51.568764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 357/721] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:39:51.615649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116d993-d438-47cc-8587-429a0dd5baf5 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:51.768267 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116d993-d438-47cc-8587-429a0dd5baf5 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:51.815803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ee2bf-10ed-4590-88c3-7d0419a077ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:51.816811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee2bf-10ed-4590-88c3-7d0419a077ad None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:51.817089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee2bf-10ed-4590-88c3-7d0419a077ad None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:51.817359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee2bf-10ed-4590-88c3-7d0419a077ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:51.827358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ee2bf-10ed-4590-88c3-7d0419a077ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:51.834187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-ba2ee2bf-10ed-4590-88c3-7d0419a077ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:39:51.835673 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 365/722] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:51.841501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb66da5-b2ee-4121-a5da-c74b92076a05 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:51.985667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb66da5-b2ee-4121-a5da-c74b92076a05 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:52.030089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5225b11-0d51-4588-82a6-9d0085bd035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:52.030774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5225b11-0d51-4588-82a6-9d0085bd035d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:52.031053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5225b11-0d51-4588-82a6-9d0085bd035d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:52.031321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5225b11-0d51-4588-82a6-9d0085bd035d None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:52.032078 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5225b11-0d51-4588-82a6-9d0085bd035d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:52.032376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5225b11-0d51-4588-82a6-9d0085bd035d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:52.033750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5225b11-0d51-4588-82a6-9d0085bd035d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:52.048356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 358/723] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:52.054708 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ee2bf-10ed-4590-88c3-7d0419a077ad None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:52.167397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6c2fa-6b41-40b5-9110-3d1f081cd51e None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:52.167700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6c2fa-6b41-40b5-9110-3d1f081cd51e None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:52.167892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6c2fa-6b41-40b5-9110-3d1f081cd51e None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:52.169962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 359/724] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:52.178112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853454cf-d6f2-4d0e-8aa7-ec0eb2a6b788 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:52.180313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853454cf-d6f2-4d0e-8aa7-ec0eb2a6b788 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:52.180313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853454cf-d6f2-4d0e-8aa7-ec0eb2a6b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:52.192339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ee2bf-10ed-4590-88c3-7d0419a077ad None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:52.211079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-853454cf-d6f2-4d0e-8aa7-ec0eb2a6b788 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:52.212485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-853454cf-d6f2-4d0e-8aa7-ec0eb2a6b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:52.228352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d264f5-5a97-418c-a69b-a28d924201df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:52.229553 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d264f5-5a97-418c-a69b-a28d924201df None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:52.230033 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d264f5-5a97-418c-a69b-a28d924201df None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:52.230517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d264f5-5a97-418c-a69b-a28d924201df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:52.242528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d264f5-5a97-418c-a69b-a28d924201df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:52.244234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d264f5-5a97-418c-a69b-a28d924201df None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:52.262337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-88d264f5-5a97-418c-a69b-a28d924201df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:52.264174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 366/725] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:52.273966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d264f5-5a97-418c-a69b-a28d924201df None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:52.360674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 360/726] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:52.391808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853454cf-d6f2-4d0e-8aa7-ec0eb2a6b788 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:52.403763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d264f5-5a97-418c-a69b-a28d924201df None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:52.479436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225f090-cb8b-43af-94ed-99ba223bd2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:52.480043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f090-cb8b-43af-94ed-99ba223bd2ec None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:52.480327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f090-cb8b-43af-94ed-99ba223bd2ec None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:52.480597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f090-cb8b-43af-94ed-99ba223bd2ec None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:52.481324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225f090-cb8b-43af-94ed-99ba223bd2ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:52.481627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225f090-cb8b-43af-94ed-99ba223bd2ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:52.483078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225f090-cb8b-43af-94ed-99ba223bd2ec None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:52.503966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 367/727] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:52.509184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225f090-cb8b-43af-94ed-99ba223bd2ec None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:52.526610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853454cf-d6f2-4d0e-8aa7-ec0eb2a6b788 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:52.588995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83856d-2196-44a5-90b2-861faae7b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:52.589721 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83856d-2196-44a5-90b2-861faae7b027 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:52.590002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83856d-2196-44a5-90b2-861faae7b027 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:52.590294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83856d-2196-44a5-90b2-861faae7b027 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:52.591030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83856d-2196-44a5-90b2-861faae7b027 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:52.592485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83856d-2196-44a5-90b2-861faae7b027 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:52.613248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 361/728] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:39:52 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:39:52.630937 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225f090-cb8b-43af-94ed-99ba223bd2ec None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:52.683433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d56136-6dd7-455c-b6a3-90f000d864d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:52.685648 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56136-6dd7-455c-b6a3-90f000d864d2 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:52.685648 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56136-6dd7-455c-b6a3-90f000d864d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:52.685648 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56136-6dd7-455c-b6a3-90f000d864d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:52.698057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d56136-6dd7-455c-b6a3-90f000d864d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:52.699645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d56136-6dd7-455c-b6a3-90f000d864d2 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:52.716544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-16d56136-6dd7-455c-b6a3-90f000d864d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:39:52.722223 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 368/729] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:52.724323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83856d-2196-44a5-90b2-861faae7b027 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:52.868390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83856d-2196-44a5-90b2-861faae7b027 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:52.904011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605a5ad-ccb4-4b45-8552-3f589743a7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:52.905103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a5ad-ccb4-4b45-8552-3f589743a7f2 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:52.905569 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a5ad-ccb4-4b45-8552-3f589743a7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:52.906113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a5ad-ccb4-4b45-8552-3f589743a7f2 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:52.907150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605a5ad-ccb4-4b45-8552-3f589743a7f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:52.907661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605a5ad-ccb4-4b45-8552-3f589743a7f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:52.909322 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605a5ad-ccb4-4b45-8552-3f589743a7f2 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:52.928368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 362/730] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Oct 28 19:39:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:52.933754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d56136-6dd7-455c-b6a3-90f000d864d2 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:53.073433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d56136-6dd7-455c-b6a3-90f000d864d2 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:53.115835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba3e62-a734-4316-a276-e25e52ebe12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:53.116486 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba3e62-a734-4316-a276-e25e52ebe12a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:53.116760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba3e62-a734-4316-a276-e25e52ebe12a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:53.117029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba3e62-a734-4316-a276-e25e52ebe12a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:53.205484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba3e62-a734-4316-a276-e25e52ebe12a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:53.207019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba3e62-a734-4316-a276-e25e52ebe12a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:53.336026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 369/731] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:39:53.341681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605a5ad-ccb4-4b45-8552-3f589743a7f2 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:53.394172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417ea8-d8f4-4afb-bccc-a5ce088ec16c None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:53.394496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417ea8-d8f4-4afb-bccc-a5ce088ec16c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:53.394741 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417ea8-d8f4-4afb-bccc-a5ce088ec16c None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:53.396779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 370/732] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:39:53.401411 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57962dc1-2757-4f7d-b0cd-55fc86dd4b7f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:53.401690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57962dc1-2757-4f7d-b0cd-55fc86dd4b7f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:53.401961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57962dc1-2757-4f7d-b0cd-55fc86dd4b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:53.434815 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-57962dc1-2757-4f7d-b0cd-55fc86dd4b7f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:53.436013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-57962dc1-2757-4f7d-b0cd-55fc86dd4b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:53.500595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605a5ad-ccb4-4b45-8552-3f589743a7f2 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:53.533892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d0fdf-ee82-48c5-9c0f-d37028c5065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:53.534844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d0fdf-ee82-48c5-9c0f-d37028c5065f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:53.535120 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d0fdf-ee82-48c5-9c0f-d37028c5065f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:53.535390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d0fdf-ee82-48c5-9c0f-d37028c5065f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:53.553756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d0fdf-ee82-48c5-9c0f-d37028c5065f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:53.556527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d0fdf-ee82-48c5-9c0f-d37028c5065f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:53.571418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 371/733] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:53.582149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-1f5d0fdf-ee82-48c5-9c0f-d37028c5065f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:53.583947 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 363/734] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:53.595175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57962dc1-2757-4f7d-b0cd-55fc86dd4b7f None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:53.626949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d0fdf-ee82-48c5-9c0f-d37028c5065f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:53.717777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57962dc1-2757-4f7d-b0cd-55fc86dd4b7f None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:53.742747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d0fdf-ee82-48c5-9c0f-d37028c5065f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:53.752441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072633a-c913-4af4-be7d-c68c0e33767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:53.753094 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072633a-c913-4af4-be7d-c68c0e33767d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:53.753374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072633a-c913-4af4-be7d-c68c0e33767d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:53.753646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072633a-c913-4af4-be7d-c68c0e33767d None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:53.754408 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072633a-c913-4af4-be7d-c68c0e33767d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:53.754713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072633a-c913-4af4-be7d-c68c0e33767d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:53.756094 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072633a-c913-4af4-be7d-c68c0e33767d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:53.767870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 372/735] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:53.769277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23763-108c-474e-af54-8da4a6162b8d None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:53.769565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23763-108c-474e-af54-8da4a6162b8d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:53.769841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23763-108c-474e-af54-8da4a6162b8d None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:53.775801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 373/736] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:53.777252 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004642c5-de93-4665-b81c-9445b1382218 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:53.777541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004642c5-de93-4665-b81c-9445b1382218 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:53.777819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004642c5-de93-4665-b81c-9445b1382218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:53.788418 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fd5cc-685b-4600-a9af-fbde373e498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:53.789223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd5cc-685b-4600-a9af-fbde373e498d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:53.789499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd5cc-685b-4600-a9af-fbde373e498d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:53.789764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd5cc-685b-4600-a9af-fbde373e498d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:53.795602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-004642c5-de93-4665-b81c-9445b1382218 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:53.796796 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-004642c5-de93-4665-b81c-9445b1382218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:53.802501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fd5cc-685b-4600-a9af-fbde373e498d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:53.811031 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-5d9fd5cc-685b-4600-a9af-fbde373e498d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:53.813231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 364/737] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:53.814248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fd5cc-685b-4600-a9af-fbde373e498d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:53.870187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 374/738] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:39:53.871113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004642c5-de93-4665-b81c-9445b1382218 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:53.931362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fd5cc-685b-4600-a9af-fbde373e498d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:53.964526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d207283-0822-4fc1-99b5-2415eae1606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:53.965340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d207283-0822-4fc1-99b5-2415eae1606a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:53.965620 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d207283-0822-4fc1-99b5-2415eae1606a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:53.965895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d207283-0822-4fc1-99b5-2415eae1606a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:53.973502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d207283-0822-4fc1-99b5-2415eae1606a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:53.975150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d207283-0822-4fc1-99b5-2415eae1606a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:53.990233 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-4d207283-0822-4fc1-99b5-2415eae1606a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:53.991908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 365/739] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:53.992715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d207283-0822-4fc1-99b5-2415eae1606a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:54.011605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004642c5-de93-4665-b81c-9445b1382218 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:54.054194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa47fb-e6c8-4943-ba3f-d12a07aa5817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:54.054956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa47fb-e6c8-4943-ba3f-d12a07aa5817 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:54.055245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa47fb-e6c8-4943-ba3f-d12a07aa5817 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:54.055515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa47fb-e6c8-4943-ba3f-d12a07aa5817 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:54.056320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa47fb-e6c8-4943-ba3f-d12a07aa5817 None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:54.056623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa47fb-e6c8-4943-ba3f-d12a07aa5817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:54.058066 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa47fb-e6c8-4943-ba3f-d12a07aa5817 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:54.067141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 375/740] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:54.067986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa47fb-e6c8-4943-ba3f-d12a07aa5817 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:54.107714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d207283-0822-4fc1-99b5-2415eae1606a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:54.149576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42af531-4e1e-4b38-ba30-ccf4cdbc083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:54.150529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42af531-4e1e-4b38-ba30-ccf4cdbc083f None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:54.150805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42af531-4e1e-4b38-ba30-ccf4cdbc083f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:54.151079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42af531-4e1e-4b38-ba30-ccf4cdbc083f None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:54.152230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42af531-4e1e-4b38-ba30-ccf4cdbc083f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:54.153611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42af531-4e1e-4b38-ba30-ccf4cdbc083f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:54.167351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa47fb-e6c8-4943-ba3f-d12a07aa5817 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:54.170572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 366/741] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:39:53 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:39:54.171495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42af531-4e1e-4b38-ba30-ccf4cdbc083f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:54.253565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68669f0-2019-402d-8a00-70f6ed0aa929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:54.254273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68669f0-2019-402d-8a00-70f6ed0aa929 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:54.254660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68669f0-2019-402d-8a00-70f6ed0aa929 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:54.254937 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68669f0-2019-402d-8a00-70f6ed0aa929 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:54.255748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68669f0-2019-402d-8a00-70f6ed0aa929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:54.256043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68669f0-2019-402d-8a00-70f6ed0aa929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:54.257521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68669f0-2019-402d-8a00-70f6ed0aa929 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:54.283987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42af531-4e1e-4b38-ba30-ccf4cdbc083f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:54.284760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 376/742] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:54.290758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68669f0-2019-402d-8a00-70f6ed0aa929 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:54.329409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3000c7-8811-4638-b5d2-c80588b78024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:54.331666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3000c7-8811-4638-b5d2-c80588b78024 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:54.331885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3000c7-8811-4638-b5d2-c80588b78024 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:54.332129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3000c7-8811-4638-b5d2-c80588b78024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:54.353424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3000c7-8811-4638-b5d2-c80588b78024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:54.354938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3000c7-8811-4638-b5d2-c80588b78024 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:54.392623 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-ce3000c7-8811-4638-b5d2-c80588b78024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:54.394388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 367/743] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:54.395699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570acbbc-bc48-4886-a57b-ab0204bad99d None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:54.395973 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570acbbc-bc48-4886-a57b-ab0204bad99d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:54.399676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570acbbc-bc48-4886-a57b-ab0204bad99d None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:54.399676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 368/744] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:54.402051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570acbbc-bc48-4886-a57b-ab0204bad99d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:54.455351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68669f0-2019-402d-8a00-70f6ed0aa929 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:54.498664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef23e-5ec7-4944-bce5-8b6a3be954f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:54.499335 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef23e-5ec7-4944-bce5-8b6a3be954f4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:54.499611 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef23e-5ec7-4944-bce5-8b6a3be954f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:54.499878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef23e-5ec7-4944-bce5-8b6a3be954f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:54.500718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef23e-5ec7-4944-bce5-8b6a3be954f4 None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=e91226b635934bfcb949577491791af4, user.id=720ff448eaea42aaa7e399e5b950b01e) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:54.501013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef23e-5ec7-4944-bce5-8b6a3be954f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:54.502486 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef23e-5ec7-4944-bce5-8b6a3be954f4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:54.508407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 377/745] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:54 2022] GET /identity/v3/role_assignments?user.id=720ff448eaea42aaa7e399e5b950b01e&scope.project.id=e91226b635934bfcb949577491791af4&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:54.509549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410af38f-196b-449c-9529-bd7f5f25ba74 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:54.509840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410af38f-196b-449c-9529-bd7f5f25ba74 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:54.510197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410af38f-196b-449c-9529-bd7f5f25ba74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:54.518813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570acbbc-bc48-4886-a57b-ab0204bad99d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:54.546595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-410af38f-196b-449c-9529-bd7f5f25ba74 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:54.549050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-410af38f-196b-449c-9529-bd7f5f25ba74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:54.591384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a57d84-80b4-4c12-89a0-63e37efe7270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:54.592765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a57d84-80b4-4c12-89a0-63e37efe7270 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:54.593229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a57d84-80b4-4c12-89a0-63e37efe7270 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:54.593705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a57d84-80b4-4c12-89a0-63e37efe7270 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:54.594693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a57d84-80b4-4c12-89a0-63e37efe7270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:54.595183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a57d84-80b4-4c12-89a0-63e37efe7270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:54.598664 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a57d84-80b4-4c12-89a0-63e37efe7270 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:54.617619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 369/746] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:54.623348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a57d84-80b4-4c12-89a0-63e37efe7270 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:54.698506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 378/747] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:39:54.725075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410af38f-196b-449c-9529-bd7f5f25ba74 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:54.808069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a57d84-80b4-4c12-89a0-63e37efe7270 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:54.865894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab79278-5056-4176-aed0-a6081df5f294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:54.866753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79278-5056-4176-aed0-a6081df5f294 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:54.867035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79278-5056-4176-aed0-a6081df5f294 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:54.867308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79278-5056-4176-aed0-a6081df5f294 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:54.878327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab79278-5056-4176-aed0-a6081df5f294 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:54.879776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab79278-5056-4176-aed0-a6081df5f294 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:54.885901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410af38f-196b-449c-9529-bd7f5f25ba74 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:54.908340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-eab79278-5056-4176-aed0-a6081df5f294 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:39:54.909972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 370/748] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Oct 28 19:39:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:54.915337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab79278-5056-4176-aed0-a6081df5f294 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:54.920769 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c59e-ed67-4750-9d9a-db089c2e83f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:54.921575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c59e-ed67-4750-9d9a-db089c2e83f1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:54.921851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c59e-ed67-4750-9d9a-db089c2e83f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:54.922139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c59e-ed67-4750-9d9a-db089c2e83f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:54.932700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c59e-ed67-4750-9d9a-db089c2e83f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:54.940042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-5cf0c59e-ed67-4750-9d9a-db089c2e83f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:39:54.941738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 379/749] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:54.947939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c59e-ed67-4750-9d9a-db089c2e83f1 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:55.098068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab79278-5056-4176-aed0-a6081df5f294 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:55.133596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccc362-b3e7-4867-a63d-bcd54325dd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:55.134304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc362-b3e7-4867-a63d-bcd54325dd36 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:55.134585 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc362-b3e7-4867-a63d-bcd54325dd36 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:55.135019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc362-b3e7-4867-a63d-bcd54325dd36 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:55.136173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccc362-b3e7-4867-a63d-bcd54325dd36 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:55.136475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccc362-b3e7-4867-a63d-bcd54325dd36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:55.137922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccc362-b3e7-4867-a63d-bcd54325dd36 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:55.144079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c59e-ed67-4750-9d9a-db089c2e83f1 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:55.159227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 371/750] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Oct 28 19:39:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:55.167185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccc362-b3e7-4867-a63d-bcd54325dd36 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:55.206858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc048565-dc10-4bbd-b97f-07114ae1bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:55.207635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc048565-dc10-4bbd-b97f-07114ae1bdfc None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:55.207917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc048565-dc10-4bbd-b97f-07114ae1bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:55.208192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc048565-dc10-4bbd-b97f-07114ae1bdfc None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:55.208955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc048565-dc10-4bbd-b97f-07114ae1bdfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:55.209433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc048565-dc10-4bbd-b97f-07114ae1bdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:55.210866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc048565-dc10-4bbd-b97f-07114ae1bdfc None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:55.227035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 380/751] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:55.233885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc048565-dc10-4bbd-b97f-07114ae1bdfc None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:55.342558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccc362-b3e7-4867-a63d-bcd54325dd36 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:55.401243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36ef39-ee87-477a-9376-38e5057fa95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:55.401821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36ef39-ee87-477a-9376-38e5057fa95d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:55.402118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36ef39-ee87-477a-9376-38e5057fa95d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:55.402400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36ef39-ee87-477a-9376-38e5057fa95d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:55.414943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc048565-dc10-4bbd-b97f-07114ae1bdfc None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:55.449010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ae4f7-11a0-46dd-a603-d3764d0fbc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:55.449821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ae4f7-11a0-46dd-a603-d3764d0fbc7e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:55.450109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ae4f7-11a0-46dd-a603-d3764d0fbc7e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:55.450401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ae4f7-11a0-46dd-a603-d3764d0fbc7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:55.461369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ae4f7-11a0-46dd-a603-d3764d0fbc7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:55.462884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ae4f7-11a0-46dd-a603-d3764d0fbc7e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:55.476971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36ef39-ee87-477a-9376-38e5057fa95d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:55.478491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36ef39-ee87-477a-9376-38e5057fa95d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:55.483774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-ac5ae4f7-11a0-46dd-a603-d3764d0fbc7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:55.485387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 381/752] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:55.486721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546a9c2-459f-4703-86fe-9e06f37e4ea4 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:55.487580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546a9c2-459f-4703-86fe-9e06f37e4ea4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:55.487869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546a9c2-459f-4703-86fe-9e06f37e4ea4 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:55.494225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 382/753] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:55.495824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546a9c2-459f-4703-86fe-9e06f37e4ea4 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:55.586291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 372/754] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:39:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:39:55.587717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9792-088b-4f6b-b9b3-ec9f3e59c331 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:55.588009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9792-088b-4f6b-b9b3-ec9f3e59c331 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:55.588286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9792-088b-4f6b-b9b3-ec9f3e59c331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:55.604787 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-de1b9792-088b-4f6b-b9b3-ec9f3e59c331 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:55.606032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-de1b9792-088b-4f6b-b9b3-ec9f3e59c331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:55.610419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546a9c2-459f-4703-86fe-9e06f37e4ea4 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:55.644550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98573c87-d09d-43ac-9c1e-81f1ec20d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:55.645452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98573c87-d09d-43ac-9c1e-81f1ec20d272 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:55.645924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98573c87-d09d-43ac-9c1e-81f1ec20d272 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:55.646419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98573c87-d09d-43ac-9c1e-81f1ec20d272 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:55.647338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98573c87-d09d-43ac-9c1e-81f1ec20d272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:55.647868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98573c87-d09d-43ac-9c1e-81f1ec20d272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:55.649447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98573c87-d09d-43ac-9c1e-81f1ec20d272 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:55.666386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 383/755] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:55.667568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98573c87-d09d-43ac-9c1e-81f1ec20d272 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:55.682105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 373/756] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:39:55.682105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b9792-088b-4f6b-b9b3-ec9f3e59c331 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:55.774700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b9792-088b-4f6b-b9b3-ec9f3e59c331 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:55.791833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98573c87-d09d-43ac-9c1e-81f1ec20d272 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:55.810967 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a049386-685f-4f49-9147-16170519e013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:55.811704 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049386-685f-4f49-9147-16170519e013 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:55.811988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049386-685f-4f49-9147-16170519e013 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:55.812261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a049386-685f-4f49-9147-16170519e013 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:55.819800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a049386-685f-4f49-9147-16170519e013 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:55.821520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a049386-685f-4f49-9147-16170519e013 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:55.829147 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa590ab-0f58-4e93-bc32-7674474b74ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:55.830258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa590ab-0f58-4e93-bc32-7674474b74ac None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:55.830786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa590ab-0f58-4e93-bc32-7674474b74ac None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:55.831269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa590ab-0f58-4e93-bc32-7674474b74ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:55.835721 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-4a049386-685f-4f49-9147-16170519e013 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:39:55.841683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 374/757] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Oct 28 19:39:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:55.841683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a049386-685f-4f49-9147-16170519e013 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:55.847068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa590ab-0f58-4e93-bc32-7674474b74ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:55.848726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa590ab-0f58-4e93-bc32-7674474b74ac None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:55.865982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-8fa590ab-0f58-4e93-bc32-7674474b74ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:55.867717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 384/758] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:55.868722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa590ab-0f58-4e93-bc32-7674474b74ac None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:55.946318 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a049386-685f-4f49-9147-16170519e013 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:55.966997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa590ab-0f58-4e93-bc32-7674474b74ac None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:55.986495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec4ab4-9894-4acc-83be-8a97d4246076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:55.987511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec4ab4-9894-4acc-83be-8a97d4246076 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:55.987888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec4ab4-9894-4acc-83be-8a97d4246076 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:55.988673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec4ab4-9894-4acc-83be-8a97d4246076 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:55.989437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec4ab4-9894-4acc-83be-8a97d4246076 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:55.991376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec4ab4-9894-4acc-83be-8a97d4246076 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.006842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd45459-9b93-4cfc-8785-5b611d25c33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.007161 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-99ec4ab4-9894-4acc-83be-8a97d4246076 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:39:56.007757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd45459-9b93-4cfc-8785-5b611d25c33e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.008131 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd45459-9b93-4cfc-8785-5b611d25c33e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.008498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd45459-9b93-4cfc-8785-5b611d25c33e None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.013840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd45459-9b93-4cfc-8785-5b611d25c33e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:56.013840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd45459-9b93-4cfc-8785-5b611d25c33e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.013840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd45459-9b93-4cfc-8785-5b611d25c33e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.014164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 375/759] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Oct 28 19:39:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:56.015265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec4ab4-9894-4acc-83be-8a97d4246076 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.036894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 385/760] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Oct 28 19:39:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:56.036894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd45459-9b93-4cfc-8785-5b611d25c33e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.127958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec4ab4-9894-4acc-83be-8a97d4246076 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:56.151076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd45459-9b93-4cfc-8785-5b611d25c33e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:56.162284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de813f7-3ee8-473c-9178-a3b08c1293bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.163242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de813f7-3ee8-473c-9178-a3b08c1293bb None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.163717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de813f7-3ee8-473c-9178-a3b08c1293bb None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.164182 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de813f7-3ee8-473c-9178-a3b08c1293bb None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.165095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de813f7-3ee8-473c-9178-a3b08c1293bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:56.165597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de813f7-3ee8-473c-9178-a3b08c1293bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.167254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de813f7-3ee8-473c-9178-a3b08c1293bb None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.180272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 376/761] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:56.181435 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de813f7-3ee8-473c-9178-a3b08c1293bb None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.189251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6208c-1468-4270-8d0a-e1ae8aeef3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.189930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6208c-1468-4270-8d0a-e1ae8aeef3f1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.190291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6208c-1468-4270-8d0a-e1ae8aeef3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.190567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6208c-1468-4270-8d0a-e1ae8aeef3f1 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.191287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6208c-1468-4270-8d0a-e1ae8aeef3f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:56.191588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6208c-1468-4270-8d0a-e1ae8aeef3f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.193412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6208c-1468-4270-8d0a-e1ae8aeef3f1 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.204416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 386/762] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:56.204416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6208c-1468-4270-8d0a-e1ae8aeef3f1 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.287551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de813f7-3ee8-473c-9178-a3b08c1293bb None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:56.321899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361eed-0acd-4c2a-bb3b-9ab3fe8e9bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.322733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361eed-0acd-4c2a-bb3b-9ab3fe8e9bb0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.323008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361eed-0acd-4c2a-bb3b-9ab3fe8e9bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.323282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361eed-0acd-4c2a-bb3b-9ab3fe8e9bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.333886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8361eed-0acd-4c2a-bb3b-9ab3fe8e9bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.335257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6208c-1468-4270-8d0a-e1ae8aeef3f1 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:56.335469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8361eed-0acd-4c2a-bb3b-9ab3fe8e9bb0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.354884 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-c8361eed-0acd-4c2a-bb3b-9ab3fe8e9bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:56.361107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 377/763] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:56.361107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361eed-0acd-4c2a-bb3b-9ab3fe8e9bb0 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.379823 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a9b8e-2c70-4c9c-91a8-477f9c7d07b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.380726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9b8e-2c70-4c9c-91a8-477f9c7d07b7 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.381006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9b8e-2c70-4c9c-91a8-477f9c7d07b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.381283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9b8e-2c70-4c9c-91a8-477f9c7d07b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.388189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a9b8e-2c70-4c9c-91a8-477f9c7d07b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.389760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a9b8e-2c70-4c9c-91a8-477f9c7d07b7 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.404063 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-9e0a9b8e-2c70-4c9c-91a8-477f9c7d07b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:56.404970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 387/764] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:56.405910 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a9b8e-2c70-4c9c-91a8-477f9c7d07b7 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.486778 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361eed-0acd-4c2a-bb3b-9ab3fe8e9bb0 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:56.505274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a9b8e-2c70-4c9c-91a8-477f9c7d07b7 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:56.529626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab3a9a-fa12-4268-b057-0b4e3099f194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.530826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab3a9a-fa12-4268-b057-0b4e3099f194 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.531581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab3a9a-fa12-4268-b057-0b4e3099f194 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.532317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab3a9a-fa12-4268-b057-0b4e3099f194 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.533360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab3a9a-fa12-4268-b057-0b4e3099f194 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:56.533904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab3a9a-fa12-4268-b057-0b4e3099f194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.536641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab3a9a-fa12-4268-b057-0b4e3099f194 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.538881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fbb90-3279-4bb9-864d-44a0b3096ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.539649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fbb90-3279-4bb9-864d-44a0b3096ade None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.540007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fbb90-3279-4bb9-864d-44a0b3096ade None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.540341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fbb90-3279-4bb9-864d-44a0b3096ade None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.541124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fbb90-3279-4bb9-864d-44a0b3096ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:56.541483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fbb90-3279-4bb9-864d-44a0b3096ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.542996 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fbb90-3279-4bb9-864d-44a0b3096ade None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.548572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 378/765] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:56.548572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab3a9a-fa12-4268-b057-0b4e3099f194 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.564735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 388/766] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:56.564735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fbb90-3279-4bb9-864d-44a0b3096ade None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.659749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab3a9a-fa12-4268-b057-0b4e3099f194 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:56.683356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fbb90-3279-4bb9-864d-44a0b3096ade None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:56.703150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f4e1d-9808-4392-a40e-1f4dabd084c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.704175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f4e1d-9808-4392-a40e-1f4dabd084c6 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.704651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f4e1d-9808-4392-a40e-1f4dabd084c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.705126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f4e1d-9808-4392-a40e-1f4dabd084c6 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.706342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f4e1d-9808-4392-a40e-1f4dabd084c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:56.706868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f4e1d-9808-4392-a40e-1f4dabd084c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.708503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f4e1d-9808-4392-a40e-1f4dabd084c6 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.717964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5984d-8b16-496c-a6f0-c582564db183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.718788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5984d-8b16-496c-a6f0-c582564db183 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.719112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5984d-8b16-496c-a6f0-c582564db183 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.719465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5984d-8b16-496c-a6f0-c582564db183 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.720275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5984d-8b16-496c-a6f0-c582564db183 None admin] RBAC: Adding query filter params (interface=public, service_id=89d6ae556e7546879ddffb9c6e57460a, region_id=RegionOne) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:56.720584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5984d-8b16-496c-a6f0-c582564db183 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.721423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 379/767] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:56.722531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5984d-8b16-496c-a6f0-c582564db183 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.722652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f4e1d-9808-4392-a40e-1f4dabd084c6 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.730449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 389/768] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/endpoints?service_id=89d6ae556e7546879ddffb9c6e57460a&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:56.731784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501772b-fbf2-4965-bf47-0495f7378cbb None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.732145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501772b-fbf2-4965-bf47-0495f7378cbb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.732419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501772b-fbf2-4965-bf47-0495f7378cbb None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.734113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 390/769] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:56.734802 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501772b-fbf2-4965-bf47-0495f7378cbb None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.824013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f4e1d-9808-4392-a40e-1f4dabd084c6 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:56.832873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501772b-fbf2-4965-bf47-0495f7378cbb None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:56.857291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5872cd-eb9d-4b09-bee0-731718c0a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.858119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5872cd-eb9d-4b09-bee0-731718c0a693 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.858398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5872cd-eb9d-4b09-bee0-731718c0a693 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.858666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5872cd-eb9d-4b09-bee0-731718c0a693 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.865267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5872cd-eb9d-4b09-bee0-731718c0a693 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.866663 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b590-3d08-4db5-ab88-c07264f570b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:56.866809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5872cd-eb9d-4b09-bee0-731718c0a693 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.867744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b590-3d08-4db5-ab88-c07264f570b1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.868218 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b590-3d08-4db5-ab88-c07264f570b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.868508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b590-3d08-4db5-ab88-c07264f570b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.869359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0b590-3d08-4db5-ab88-c07264f570b1 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=c7fc75fab2e247ceaf897723c15023f9) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:56.869660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0b590-3d08-4db5-ab88-c07264f570b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:56.871127 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0b590-3d08-4db5-ab88-c07264f570b1 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:56.879465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 391/770] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/role_assignments?user.id=c7fc75fab2e247ceaf897723c15023f9&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:56.879465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b590-3d08-4db5-ab88-c07264f570b1 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:56.880802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-eb5872cd-eb9d-4b09-bee0-731718c0a693 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:56.886893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 380/771] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:56.886893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e7a6f-c21f-4243-a280-faab52337171 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:56.886893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e7a6f-c21f-4243-a280-faab52337171 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:56.886893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e7a6f-c21f-4243-a280-faab52337171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:56.904652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-490e7a6f-c21f-4243-a280-faab52337171 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:56.906064 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-490e7a6f-c21f-4243-a280-faab52337171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:56.992084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 381/772] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:39:56.993010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e7a6f-c21f-4243-a280-faab52337171 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:57.020313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b590-3d08-4db5-ab88-c07264f570b1 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:57.060753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d5005-6730-435e-a4f4-3a29153063eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:57.061429 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d5005-6730-435e-a4f4-3a29153063eb None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.061709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d5005-6730-435e-a4f4-3a29153063eb None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.061982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d5005-6730-435e-a4f4-3a29153063eb None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.062735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d5005-6730-435e-a4f4-3a29153063eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:57.064121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d5005-6730-435e-a4f4-3a29153063eb None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:57.069963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 392/773] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:57.071198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27103908-3c58-4965-bec0-61be760717cd None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.071198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27103908-3c58-4965-bec0-61be760717cd None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.071503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27103908-3c58-4965-bec0-61be760717cd None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.073359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 393/774] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:39:57.078473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27103908-3c58-4965-bec0-61be760717cd None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:57.097626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e7a6f-c21f-4243-a280-faab52337171 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:57.144957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707876fd-ec80-44a3-8de7-b4194d2edd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:57.145659 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707876fd-ec80-44a3-8de7-b4194d2edd12 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.145944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707876fd-ec80-44a3-8de7-b4194d2edd12 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.146270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707876fd-ec80-44a3-8de7-b4194d2edd12 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.147076 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707876fd-ec80-44a3-8de7-b4194d2edd12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:57.147385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707876fd-ec80-44a3-8de7-b4194d2edd12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:57.148860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707876fd-ec80-44a3-8de7-b4194d2edd12 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:57.166392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 382/775] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:57.168282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbcbc8-3bd9-4298-9568-33042ee6a565 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.168757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbcbc8-3bd9-4298-9568-33042ee6a565 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.169216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbcbc8-3bd9-4298-9568-33042ee6a565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.194788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d1dbcbc8-3bd9-4298-9568-33042ee6a565 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:57.196000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d1dbcbc8-3bd9-4298-9568-33042ee6a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:57.213544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27103908-3c58-4965-bec0-61be760717cd None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:57.263276 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555d43f-cfdc-4f28-8ebb-7d4060d378f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:57.264956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555d43f-cfdc-4f28-8ebb-7d4060d378f5 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.265605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555d43f-cfdc-4f28-8ebb-7d4060d378f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.266221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555d43f-cfdc-4f28-8ebb-7d4060d378f5 None admin] PATH_INFO: `/v3/services/network` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.266950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555d43f-cfdc-4f28-8ebb-7d4060d378f5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:57.268782 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555d43f-cfdc-4f28-8ebb-7d4060d378f5 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:57.280229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 383/776] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:39:57.281342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbcbc8-3bd9-4298-9568-33042ee6a565 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:57.282140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c555d43f-cfdc-4f28-8ebb-7d4060d378f5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:39:57.283749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 394/777] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:57 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:57.295085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555d43f-cfdc-4f28-8ebb-7d4060d378f5 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:57.409001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbcbc8-3bd9-4298-9568-33042ee6a565 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:57.411026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555d43f-cfdc-4f28-8ebb-7d4060d378f5 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:57.445251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76338e7d-fc07-41ab-af7e-6e93db70037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:57.446265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76338e7d-fc07-41ab-af7e-6e93db70037c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.446730 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76338e7d-fc07-41ab-af7e-6e93db70037c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.447099 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76338e7d-fc07-41ab-af7e-6e93db70037c None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.447998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76338e7d-fc07-41ab-af7e-6e93db70037c None admin] RBAC: Adding query filter params (name=network) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:57.448394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76338e7d-fc07-41ab-af7e-6e93db70037c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:57.448513 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352de84a-f0a9-4dc4-8584-ac7b16d66c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:57.449345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de84a-f0a9-4dc4-8584-ac7b16d66c42 None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.449622 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de84a-f0a9-4dc4-8584-ac7b16d66c42 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.449890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de84a-f0a9-4dc4-8584-ac7b16d66c42 None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/be7be85d70b64273b7904082ee2ba848/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.450352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76338e7d-fc07-41ab-af7e-6e93db70037c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:57.452030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352de84a-f0a9-4dc4-8584-ac7b16d66c42 None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=be7be85d70b64273b7904082ee2ba848, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:57.454019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352de84a-f0a9-4dc4-8584-ac7b16d66c42 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:57.459999 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 395/778] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:39:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:57.461008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76338e7d-fc07-41ab-af7e-6e93db70037c None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:57.469615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 384/779] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:39:57 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/be7be85d70b64273b7904082ee2ba848/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:39:57.470875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352de84a-f0a9-4dc4-8584-ac7b16d66c42 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:57.575257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76338e7d-fc07-41ab-af7e-6e93db70037c None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:57.604434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352de84a-f0a9-4dc4-8584-ac7b16d66c42 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:57.611548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7ee46-869e-42aa-bb82-7ebf510197d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:57.612756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7ee46-869e-42aa-bb82-7ebf510197d3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.613105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7ee46-869e-42aa-bb82-7ebf510197d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.613448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7ee46-869e-42aa-bb82-7ebf510197d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.626755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7ee46-869e-42aa-bb82-7ebf510197d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:57.634062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-6ae7ee46-869e-42aa-bb82-7ebf510197d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:39:57.635713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 396/780] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:57.644208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7ee46-869e-42aa-bb82-7ebf510197d3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:57.656161 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70601866-95fa-4e50-818e-079061e023b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:57.657189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70601866-95fa-4e50-818e-079061e023b9 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.657656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70601866-95fa-4e50-818e-079061e023b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.658184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70601866-95fa-4e50-818e-079061e023b9 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.659192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70601866-95fa-4e50-818e-079061e023b9 None admin] RBAC: Adding query filter params (type=network) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:57.660058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70601866-95fa-4e50-818e-079061e023b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:57.662798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70601866-95fa-4e50-818e-079061e023b9 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:57.670144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 385/781] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:39:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:57.681291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70601866-95fa-4e50-818e-079061e023b9 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:57.807025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7ee46-869e-42aa-bb82-7ebf510197d3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:57.826136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70601866-95fa-4e50-818e-079061e023b9 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:57.845250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915aab2-8d05-46ea-9c56-3c602af0de9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:57.846052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915aab2-8d05-46ea-9c56-3c602af0de9c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.846368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915aab2-8d05-46ea-9c56-3c602af0de9c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.846690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915aab2-8d05-46ea-9c56-3c602af0de9c None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.847454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915aab2-8d05-46ea-9c56-3c602af0de9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:57.847766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915aab2-8d05-46ea-9c56-3c602af0de9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:57.849159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915aab2-8d05-46ea-9c56-3c602af0de9c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:57.858059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 397/782] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:39:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:57.861220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8088c4a-991c-40c2-9f18-d661c9ce823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:57.861937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8088c4a-991c-40c2-9f18-d661c9ce823a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:57.862284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8088c4a-991c-40c2-9f18-d661c9ce823a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:57.862559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8088c4a-991c-40c2-9f18-d661c9ce823a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:57.863357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8088c4a-991c-40c2-9f18-d661c9ce823a None admin] RBAC: Adding query filter params (interface=public, service_id=4b60ec58b8ed46709a2999d1396f3f2a, region_id=RegionOne) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:57.863716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8088c4a-991c-40c2-9f18-d661c9ce823a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:57.865383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915aab2-8d05-46ea-9c56-3c602af0de9c None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:57.872677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8088c4a-991c-40c2-9f18-d661c9ce823a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:57.892112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 386/783] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Oct 28 19:39:57 2022] GET /identity/v3/endpoints?service_id=4b60ec58b8ed46709a2999d1396f3f2a&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:57.897720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8088c4a-991c-40c2-9f18-d661c9ce823a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:58.046380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915aab2-8d05-46ea-9c56-3c602af0de9c None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:58.087875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8088c4a-991c-40c2-9f18-d661c9ce823a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:58.115489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b741a-233a-43ca-b611-269209221f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:58.116302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b741a-233a-43ca-b611-269209221f13 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:58.116575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b741a-233a-43ca-b611-269209221f13 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:58.116894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b741a-233a-43ca-b611-269209221f13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:58.134017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b741a-233a-43ca-b611-269209221f13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:58.135530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b741a-233a-43ca-b611-269209221f13 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:58.151839 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-6c5b741a-233a-43ca-b611-269209221f13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:58.152062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a9bec-b9e0-4faa-9e9d-ee21392438a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:58.152709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a9bec-b9e0-4faa-9e9d-ee21392438a1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:58.152987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a9bec-b9e0-4faa-9e9d-ee21392438a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:58.153260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a9bec-b9e0-4faa-9e9d-ee21392438a1 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:58.153371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 398/784] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:39:58.153957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a9bec-b9e0-4faa-9e9d-ee21392438a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:58.155358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a9bec-b9e0-4faa-9e9d-ee21392438a1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:58.158857 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b741a-233a-43ca-b611-269209221f13 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:58.172749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 387/785] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Oct 28 19:39:57 2022] GET /identity/v3/services => generated 772 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:58.309123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b741a-233a-43ca-b611-269209221f13 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:58.357712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebacf77-ca5d-4453-b4ec-f33b5561859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:58.358427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebacf77-ca5d-4453-b4ec-f33b5561859f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:58.358707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebacf77-ca5d-4453-b4ec-f33b5561859f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:58.358983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebacf77-ca5d-4453-b4ec-f33b5561859f None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:58.359713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebacf77-ca5d-4453-b4ec-f33b5561859f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:58.360021 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebacf77-ca5d-4453-b4ec-f33b5561859f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:58.361389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebacf77-ca5d-4453-b4ec-f33b5561859f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:58.380685 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 399/786] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:58.385993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a9bec-b9e0-4faa-9e9d-ee21392438a1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:58.513051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a9bec-b9e0-4faa-9e9d-ee21392438a1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:58.547076 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55910e-13dd-4ed4-b541-5edf96cbdd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:58.548298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55910e-13dd-4ed4-b541-5edf96cbdd1d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:58.549209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55910e-13dd-4ed4-b541-5edf96cbdd1d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:58.549675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55910e-13dd-4ed4-b541-5edf96cbdd1d None admin] PATH_INFO: `/v3/users/swift` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:58.558764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55910e-13dd-4ed4-b541-5edf96cbdd1d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:58.560673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55910e-13dd-4ed4-b541-5edf96cbdd1d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:58.575361 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-4f55910e-13dd-4ed4-b541-5edf96cbdd1d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:39:58.577336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 388/787] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:39:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:58.582649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebacf77-ca5d-4453-b4ec-f33b5561859f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:58.684121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebacf77-ca5d-4453-b4ec-f33b5561859f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:58.718418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b125c-33de-4be9-8dbd-b2ce364498b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:58.719093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b125c-33de-4be9-8dbd-b2ce364498b1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:58.719369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b125c-33de-4be9-8dbd-b2ce364498b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:58.719643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b125c-33de-4be9-8dbd-b2ce364498b1 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:58.720483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b125c-33de-4be9-8dbd-b2ce364498b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:58.720783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b125c-33de-4be9-8dbd-b2ce364498b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:58.722536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b125c-33de-4be9-8dbd-b2ce364498b1 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:58.740874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 400/788] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Oct 28 19:39:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:39:58.749036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55910e-13dd-4ed4-b541-5edf96cbdd1d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:58.901848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55910e-13dd-4ed4-b541-5edf96cbdd1d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:58.948174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0a872-2e49-4200-92bb-a8651a57e309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:58.948992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0a872-2e49-4200-92bb-a8651a57e309 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:58.949268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0a872-2e49-4200-92bb-a8651a57e309 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:58.949537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0a872-2e49-4200-92bb-a8651a57e309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:58.963736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0a872-2e49-4200-92bb-a8651a57e309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:58.965223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0a872-2e49-4200-92bb-a8651a57e309 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:58.985507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-edc0a872-2e49-4200-92bb-a8651a57e309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:39:58.988970 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 389/789] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:58.992975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b125c-33de-4be9-8dbd-b2ce364498b1 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:59.090228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b125c-33de-4be9-8dbd-b2ce364498b1 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:59.125731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404f8a9-fa05-4539-a68a-1967c6fa78ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:59.126790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404f8a9-fa05-4539-a68a-1967c6fa78ee None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:59.127104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404f8a9-fa05-4539-a68a-1967c6fa78ee None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:59.127382 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404f8a9-fa05-4539-a68a-1967c6fa78ee None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:59.128112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404f8a9-fa05-4539-a68a-1967c6fa78ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:59.128417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404f8a9-fa05-4539-a68a-1967c6fa78ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:59.129884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404f8a9-fa05-4539-a68a-1967c6fa78ee None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:59.144814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 401/790] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:59.150297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0a872-2e49-4200-92bb-a8651a57e309 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:59.284992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0a872-2e49-4200-92bb-a8651a57e309 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:59.329518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9809613-974a-457f-a722-19aa455166ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:59.330389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9809613-974a-457f-a722-19aa455166ca None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:59.330669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9809613-974a-457f-a722-19aa455166ca None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:59.330942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9809613-974a-457f-a722-19aa455166ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:59.338046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9809613-974a-457f-a722-19aa455166ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:59.339538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9809613-974a-457f-a722-19aa455166ca None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:59.356648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-c9809613-974a-457f-a722-19aa455166ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:39:59.358014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 390/791] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:59.363943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404f8a9-fa05-4539-a68a-1967c6fa78ee None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:59.467434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001043-96d7-40c0-b6ac-ff67887cbe21 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:59.467756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001043-96d7-40c0-b6ac-ff67887cbe21 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:59.468037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001043-96d7-40c0-b6ac-ff67887cbe21 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:59.469804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 391/792] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:39:59.474986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb772c-1f50-463b-bf40-a699b7a6fe84 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:59.475266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb772c-1f50-463b-bf40-a699b7a6fe84 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:59.475541 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb772c-1f50-463b-bf40-a699b7a6fe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:59.499321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404f8a9-fa05-4539-a68a-1967c6fa78ee None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:59.501392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b9bb772c-1f50-463b-bf40-a699b7a6fe84 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:39:59.502679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b9bb772c-1f50-463b-bf40-a699b7a6fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:39:59.559992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8c1e9-bb28-46cd-a011-74e3fb36a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:59.560579 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8c1e9-bb28-46cd-a011-74e3fb36a67f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:59.560860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8c1e9-bb28-46cd-a011-74e3fb36a67f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:59.561130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8c1e9-bb28-46cd-a011-74e3fb36a67f None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:59.561920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8c1e9-bb28-46cd-a011-74e3fb36a67f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:39:59.562246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8c1e9-bb28-46cd-a011-74e3fb36a67f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:59.563694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8c1e9-bb28-46cd-a011-74e3fb36a67f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:59.589606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 402/793] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:39:59.593561 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8c1e9-bb28-46cd-a011-74e3fb36a67f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:59.624303 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 392/794] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:39:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:39:59.659052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb772c-1f50-463b-bf40-a699b7a6fe84 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:39:59.750715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8c1e9-bb28-46cd-a011-74e3fb36a67f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:59.806301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507374b-0172-4662-a6b0-ecd4f8425be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:59.808324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507374b-0172-4662-a6b0-ecd4f8425be3 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:59.809456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507374b-0172-4662-a6b0-ecd4f8425be3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:59.810138 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507374b-0172-4662-a6b0-ecd4f8425be3 None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/720ff448eaea42aaa7e399e5b950b01e/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:59.813865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507374b-0172-4662-a6b0-ecd4f8425be3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=720ff448eaea42aaa7e399e5b950b01e, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:39:59.816300 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507374b-0172-4662-a6b0-ecd4f8425be3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:39:59.824689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb772c-1f50-463b-bf40-a699b7a6fe84 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:39:59.841680 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 403/795] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:39:59 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/720ff448eaea42aaa7e399e5b950b01e/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:39:59.870026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868cb10-2bb3-4319-a080-d85e4306b288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:39:59.871327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868cb10-2bb3-4319-a080-d85e4306b288 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:39:59.871813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868cb10-2bb3-4319-a080-d85e4306b288 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:39:59.872409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868cb10-2bb3-4319-a080-d85e4306b288 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:39:59.891667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868cb10-2bb3-4319-a080-d85e4306b288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:39:59.900185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-4868cb10-2bb3-4319-a080-d85e4306b288 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:39:59.902496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 393/796] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:39:59.908430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507374b-0172-4662-a6b0-ecd4f8425be3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:00.001710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb839f-8abf-421b-a9fa-a4f72c7b758f None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.002365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb839f-8abf-421b-a9fa-a4f72c7b758f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.002805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb839f-8abf-421b-a9fa-a4f72c7b758f None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.005046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 394/797] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:00.010611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b875b3-6b72-49dc-8992-4a4190a3d99f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.010982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b875b3-6b72-49dc-8992-4a4190a3d99f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.011386 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b875b3-6b72-49dc-8992-4a4190a3d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.027043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507374b-0172-4662-a6b0-ecd4f8425be3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:00.035150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-69b875b3-6b72-49dc-8992-4a4190a3d99f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:00.036551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-69b875b3-6b72-49dc-8992-4a4190a3d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:00.064788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7592ca-1d1d-46a6-a128-fcfd6295daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:00.065811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7592ca-1d1d-46a6-a128-fcfd6295daa9 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.066298 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7592ca-1d1d-46a6-a128-fcfd6295daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.066782 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7592ca-1d1d-46a6-a128-fcfd6295daa9 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.067723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7592ca-1d1d-46a6-a128-fcfd6295daa9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:00.068223 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7592ca-1d1d-46a6-a128-fcfd6295daa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:00.069832 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7592ca-1d1d-46a6-a128-fcfd6295daa9 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:00.079053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 404/798] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:39:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:00.085010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7592ca-1d1d-46a6-a128-fcfd6295daa9 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:00.162192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 395/799] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:00.183939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b875b3-6b72-49dc-8992-4a4190a3d99f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:00.220901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7592ca-1d1d-46a6-a128-fcfd6295daa9 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:00.260230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a587-d7aa-4699-a666-a878769b07d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:00.261584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a587-d7aa-4699-a666-a878769b07d9 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.262050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a587-d7aa-4699-a666-a878769b07d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.262553 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a587-d7aa-4699-a666-a878769b07d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.275068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a587-d7aa-4699-a666-a878769b07d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:00.276841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a587-d7aa-4699-a666-a878769b07d9 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:00.295811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-32d8a587-d7aa-4699-a666-a878769b07d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:00.297882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 405/800] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:00.303596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a587-d7aa-4699-a666-a878769b07d9 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:00.343123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b875b3-6b72-49dc-8992-4a4190a3d99f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:00.376026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea834e1-7890-4aee-b2c6-29a253066cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:00.376878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea834e1-7890-4aee-b2c6-29a253066cd9 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.377157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea834e1-7890-4aee-b2c6-29a253066cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.377429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea834e1-7890-4aee-b2c6-29a253066cd9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.378107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea834e1-7890-4aee-b2c6-29a253066cd9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:00.379529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea834e1-7890-4aee-b2c6-29a253066cd9 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:00.390892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-3ea834e1-7890-4aee-b2c6-29a253066cd9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:40:00.392265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 396/801] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Oct 28 19:40:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:00.393617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d6e7-4cb3-4782-8705-24e571bed3a7 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.393901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d6e7-4cb3-4782-8705-24e571bed3a7 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.394194 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d6e7-4cb3-4782-8705-24e571bed3a7 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.396113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 397/802] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:00.397610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d6e7-4cb3-4782-8705-24e571bed3a7 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:00.419732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a587-d7aa-4699-a666-a878769b07d9 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:00.463208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d330cb-e12b-4d27-8fb7-8d8743387113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:00.464392 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d330cb-e12b-4d27-8fb7-8d8743387113 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.464810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d330cb-e12b-4d27-8fb7-8d8743387113 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.465216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d330cb-e12b-4d27-8fb7-8d8743387113 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.466588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d330cb-e12b-4d27-8fb7-8d8743387113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:00.467032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d330cb-e12b-4d27-8fb7-8d8743387113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:00.468973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d330cb-e12b-4d27-8fb7-8d8743387113 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:00.490196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 406/803] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:00.491945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b2be2-9ffe-4eb1-ad6a-71ee85b32cb9 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.492466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b2be2-9ffe-4eb1-ad6a-71ee85b32cb9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.493237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b2be2-9ffe-4eb1-ad6a-71ee85b32cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.517026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-694b2be2-9ffe-4eb1-ad6a-71ee85b32cb9 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:00.518445 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-694b2be2-9ffe-4eb1-ad6a-71ee85b32cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:00.519365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d6e7-4cb3-4782-8705-24e571bed3a7 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:00.564935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96df77-8824-4214-abfc-c32299743345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:00.566040 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96df77-8824-4214-abfc-c32299743345 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.566441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96df77-8824-4214-abfc-c32299743345 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.566806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96df77-8824-4214-abfc-c32299743345 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.567771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96df77-8824-4214-abfc-c32299743345 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:00.568189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96df77-8824-4214-abfc-c32299743345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:00.569982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96df77-8824-4214-abfc-c32299743345 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:00.576489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 398/804] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Oct 28 19:40:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:00.577920 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96df77-8824-4214-abfc-c32299743345 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:00.585478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 407/805] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:00.586581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b2be2-9ffe-4eb1-ad6a-71ee85b32cb9 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:00.691375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96df77-8824-4214-abfc-c32299743345 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:00.703287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b2be2-9ffe-4eb1-ad6a-71ee85b32cb9 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:00.734295 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d794d-5813-4a93-9f42-0b1bcf239c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:00.735267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d794d-5813-4a93-9f42-0b1bcf239c97 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.735662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d794d-5813-4a93-9f42-0b1bcf239c97 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.736003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d794d-5813-4a93-9f42-0b1bcf239c97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.738400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034e3cb-3542-4d21-9eb6-8116b84c4d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:00.739220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e3cb-3542-4d21-9eb6-8116b84c4d4b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.739721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e3cb-3542-4d21-9eb6-8116b84c4d4b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.740179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e3cb-3542-4d21-9eb6-8116b84c4d4b None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.741141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034e3cb-3542-4d21-9eb6-8116b84c4d4b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:00.741653 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034e3cb-3542-4d21-9eb6-8116b84c4d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:00.743233 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034e3cb-3542-4d21-9eb6-8116b84c4d4b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:00.743777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d794d-5813-4a93-9f42-0b1bcf239c97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:00.745414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d794d-5813-4a93-9f42-0b1bcf239c97 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:00.750340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 408/806] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Oct 28 19:40:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:00.751477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034e3cb-3542-4d21-9eb6-8116b84c4d4b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:00.762836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-5f6d794d-5813-4a93-9f42-0b1bcf239c97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:40:00.764654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 399/807] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Oct 28 19:40:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:00.766587 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d794d-5813-4a93-9f42-0b1bcf239c97 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:00.875066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d794d-5813-4a93-9f42-0b1bcf239c97 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:00.880844 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034e3cb-3542-4d21-9eb6-8116b84c4d4b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:00.911074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b32766-258d-4e22-9238-8f65b267c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:00.911786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b32766-258d-4e22-9238-8f65b267c3d0 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.912162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b32766-258d-4e22-9238-8f65b267c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.912528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b32766-258d-4e22-9238-8f65b267c3d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.913404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b32766-258d-4e22-9238-8f65b267c3d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:00.914975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b32766-258d-4e22-9238-8f65b267c3d0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:00.915373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374871-958c-4f2b-ac0b-81f1b7e3097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:00.916349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374871-958c-4f2b-ac0b-81f1b7e3097b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:00.916789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374871-958c-4f2b-ac0b-81f1b7e3097b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:00.917199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374871-958c-4f2b-ac0b-81f1b7e3097b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:00.928369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74374871-958c-4f2b-ac0b-81f1b7e3097b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:00.935344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-74374871-958c-4f2b-ac0b-81f1b7e3097b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:40:00.936853 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 409/808] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:00.937631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374871-958c-4f2b-ac0b-81f1b7e3097b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:00.942725 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 400/809] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:40:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:00.947782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b32766-258d-4e22-9238-8f65b267c3d0 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:01.070394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374871-958c-4f2b-ac0b-81f1b7e3097b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:01.114368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437d3fb-8ec1-4acb-bc48-d9ddef83e5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:01.115111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437d3fb-8ec1-4acb-bc48-d9ddef83e5fd None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.115393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437d3fb-8ec1-4acb-bc48-d9ddef83e5fd None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.115665 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437d3fb-8ec1-4acb-bc48-d9ddef83e5fd None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.116514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437d3fb-8ec1-4acb-bc48-d9ddef83e5fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:01.116820 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437d3fb-8ec1-4acb-bc48-d9ddef83e5fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:01.118374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437d3fb-8ec1-4acb-bc48-d9ddef83e5fd None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:01.152373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 410/810] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Oct 28 19:40:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:01.158605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437d3fb-8ec1-4acb-bc48-d9ddef83e5fd None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:01.200162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b32766-258d-4e22-9238-8f65b267c3d0 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:01.243263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41724c12-92f8-43fd-b13f-fe364e41d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:01.244398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41724c12-92f8-43fd-b13f-fe364e41d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.244818 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41724c12-92f8-43fd-b13f-fe364e41d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.245795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41724c12-92f8-43fd-b13f-fe364e41d3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.247036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41724c12-92f8-43fd-b13f-fe364e41d3e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:01.247505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41724c12-92f8-43fd-b13f-fe364e41d3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:01.250049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41724c12-92f8-43fd-b13f-fe364e41d3e2 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:01.261741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 401/811] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:01.267936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41724c12-92f8-43fd-b13f-fe364e41d3e2 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:01.288526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437d3fb-8ec1-4acb-bc48-d9ddef83e5fd None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:01.325252 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb56150-97f5-4eb3-8fcb-147ce72db103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:01.326064 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb56150-97f5-4eb3-8fcb-147ce72db103 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.326371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb56150-97f5-4eb3-8fcb-147ce72db103 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.326646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb56150-97f5-4eb3-8fcb-147ce72db103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.336773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb56150-97f5-4eb3-8fcb-147ce72db103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:01.338275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb56150-97f5-4eb3-8fcb-147ce72db103 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:01.355058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-aeb56150-97f5-4eb3-8fcb-147ce72db103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:01.356604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 411/812] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:01.361693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee61b-50d5-4cd5-9106-5911669e3a13 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.361693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee61b-50d5-4cd5-9106-5911669e3a13 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.361693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee61b-50d5-4cd5-9106-5911669e3a13 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.361693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 412/813] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:01.362838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee61b-50d5-4cd5-9106-5911669e3a13 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:01.401859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41724c12-92f8-43fd-b13f-fe364e41d3e2 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:01.442851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7487c-7004-4e34-8248-078ddaa77777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:01.444261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7487c-7004-4e34-8248-078ddaa77777 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.444990 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7487c-7004-4e34-8248-078ddaa77777 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.445682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7487c-7004-4e34-8248-078ddaa77777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.459247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7487c-7004-4e34-8248-078ddaa77777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:01.461635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7487c-7004-4e34-8248-078ddaa77777 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:01.466923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee61b-50d5-4cd5-9106-5911669e3a13 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:01.483075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-97c7487c-7004-4e34-8248-078ddaa77777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:01.485258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 402/814] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:01.486753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a07194-efc1-49eb-af4f-8314bdb79fdd None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.487593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a07194-efc1-49eb-af4f-8314bdb79fdd None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.488033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a07194-efc1-49eb-af4f-8314bdb79fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.503237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cdfac-e06e-438f-a767-d5b7230260c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:01.504397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cdfac-e06e-438f-a767-d5b7230260c3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.504837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cdfac-e06e-438f-a767-d5b7230260c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.505271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cdfac-e06e-438f-a767-d5b7230260c3 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.506187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cdfac-e06e-438f-a767-d5b7230260c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:01.506630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cdfac-e06e-438f-a767-d5b7230260c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:01.507836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f3a07194-efc1-49eb-af4f-8314bdb79fdd None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:01.508394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cdfac-e06e-438f-a767-d5b7230260c3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:01.509061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f3a07194-efc1-49eb-af4f-8314bdb79fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:01.527384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 413/815] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:01.527384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cdfac-e06e-438f-a767-d5b7230260c3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:01.582525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 403/816] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:01.583428 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a07194-efc1-49eb-af4f-8314bdb79fdd None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:01.646520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cdfac-e06e-438f-a767-d5b7230260c3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:01.681438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a07194-efc1-49eb-af4f-8314bdb79fdd None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:01.689390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2ff9f-b634-4896-a412-44e49962709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:01.690379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2ff9f-b634-4896-a412-44e49962709f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.690839 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2ff9f-b634-4896-a412-44e49962709f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.691670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2ff9f-b634-4896-a412-44e49962709f None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.692891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2ff9f-b634-4896-a412-44e49962709f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:01.693377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2ff9f-b634-4896-a412-44e49962709f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:01.695404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2ff9f-b634-4896-a412-44e49962709f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:01.711828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 414/817] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:01.712964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2ff9f-b634-4896-a412-44e49962709f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:01.716099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850ee4-40d6-4b8e-b61e-27fc371571ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:01.717390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850ee4-40d6-4b8e-b61e-27fc371571ab None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.717507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850ee4-40d6-4b8e-b61e-27fc371571ab None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.717840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850ee4-40d6-4b8e-b61e-27fc371571ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.726509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850ee4-40d6-4b8e-b61e-27fc371571ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:01.727975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850ee4-40d6-4b8e-b61e-27fc371571ab None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:01.741641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-d8850ee4-40d6-4b8e-b61e-27fc371571ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:01.747798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 404/818] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:01.747798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850ee4-40d6-4b8e-b61e-27fc371571ab None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:01.840446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2ff9f-b634-4896-a412-44e49962709f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:01.847333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850ee4-40d6-4b8e-b61e-27fc371571ab None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:01.883497 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ddca1-5baa-4a1f-a34e-abfbb316f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:01.883706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f63ad6-8869-4c88-8349-486ead989f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:01.884439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ddca1-5baa-4a1f-a34e-abfbb316f93d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.884805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ddca1-5baa-4a1f-a34e-abfbb316f93d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.885164 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ddca1-5baa-4a1f-a34e-abfbb316f93d None admin] PATH_INFO: `/v3/services/network` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.885555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f63ad6-8869-4c88-8349-486ead989f49 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:01.885987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f63ad6-8869-4c88-8349-486ead989f49 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:01.886129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ddca1-5baa-4a1f-a34e-abfbb316f93d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:01.886527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f63ad6-8869-4c88-8349-486ead989f49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:01.887650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ddca1-5baa-4a1f-a34e-abfbb316f93d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:01.895867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f63ad6-8869-4c88-8349-486ead989f49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:01.897516 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f63ad6-8869-4c88-8349-486ead989f49 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:01.899467 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-ad7ddca1-5baa-4a1f-a34e-abfbb316f93d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:40:01.905598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 415/819] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:01 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:01.906603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ddca1-5baa-4a1f-a34e-abfbb316f93d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:01.913114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a6f63ad6-8869-4c88-8349-486ead989f49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:40:01.914815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 405/820] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Oct 28 19:40:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:01.915735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f63ad6-8869-4c88-8349-486ead989f49 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:02.018653 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ddca1-5baa-4a1f-a34e-abfbb316f93d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:02.032415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f63ad6-8869-4c88-8349-486ead989f49 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:02.054395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebe341-ddce-49ab-bd5f-dda578599b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:02.054626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f02bb-d939-4a6e-90d7-d895b79af661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:02.055318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f02bb-d939-4a6e-90d7-d895b79af661 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.055665 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebe341-ddce-49ab-bd5f-dda578599b0b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.055778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f02bb-d939-4a6e-90d7-d895b79af661 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.056052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f02bb-d939-4a6e-90d7-d895b79af661 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.056424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebe341-ddce-49ab-bd5f-dda578599b0b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.056888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebe341-ddce-49ab-bd5f-dda578599b0b None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.056995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f02bb-d939-4a6e-90d7-d895b79af661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:02.057310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f02bb-d939-4a6e-90d7-d895b79af661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:02.058061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebe341-ddce-49ab-bd5f-dda578599b0b None admin] RBAC: Adding query filter params (name=network) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:02.058580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebe341-ddce-49ab-bd5f-dda578599b0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:02.058949 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f02bb-d939-4a6e-90d7-d895b79af661 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:02.060320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebe341-ddce-49ab-bd5f-dda578599b0b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:02.065480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 406/821] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:40:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:02.066552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebe341-ddce-49ab-bd5f-dda578599b0b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:02.081683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 416/822] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:02.081683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f02bb-d939-4a6e-90d7-d895b79af661 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:02.174306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebe341-ddce-49ab-bd5f-dda578599b0b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:02.180062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f02bb-d939-4a6e-90d7-d895b79af661 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:02.209614 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c90cc-252c-4993-870d-ba11c08325d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:02.210972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c90cc-252c-4993-870d-ba11c08325d3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.211501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c90cc-252c-4993-870d-ba11c08325d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.211980 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c90cc-252c-4993-870d-ba11c08325d3 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.213017 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c90cc-252c-4993-870d-ba11c08325d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:02.213526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c90cc-252c-4993-870d-ba11c08325d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:02.214119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b44c2-4e0e-4de7-9f73-a43edb6e429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:02.214790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b44c2-4e0e-4de7-9f73-a43edb6e429b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.215065 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b44c2-4e0e-4de7-9f73-a43edb6e429b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.215334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b44c2-4e0e-4de7-9f73-a43edb6e429b None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.216040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b44c2-4e0e-4de7-9f73-a43edb6e429b None admin] RBAC: Adding query filter params (type=network) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:02.216343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b44c2-4e0e-4de7-9f73-a43edb6e429b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:02.216459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c90cc-252c-4993-870d-ba11c08325d3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:02.217703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b44c2-4e0e-4de7-9f73-a43edb6e429b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:02.228089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 417/823] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:40:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:02.228953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b44c2-4e0e-4de7-9f73-a43edb6e429b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:02.237071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 407/824] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Oct 28 19:40:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:02.238267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c90cc-252c-4993-870d-ba11c08325d3 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:02.340839 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b44c2-4e0e-4de7-9f73-a43edb6e429b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:02.359208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c90cc-252c-4993-870d-ba11c08325d3 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:02.384493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f868ce5-a32d-446e-8148-88341810d7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:02.386282 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868ce5-a32d-446e-8148-88341810d7c0 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.387026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868ce5-a32d-446e-8148-88341810d7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.387507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868ce5-a32d-446e-8148-88341810d7c0 None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/c7fc75fab2e247ceaf897723c15023f9/roles/143037337c76416d8ad332410c456159` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.393050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9d090-0e47-49d0-aa76-d9e9e00c070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:02.393712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9d090-0e47-49d0-aa76-d9e9e00c070e None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.394044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9d090-0e47-49d0-aa76-d9e9e00c070e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.394340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9d090-0e47-49d0-aa76-d9e9e00c070e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.395075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9d090-0e47-49d0-aa76-d9e9e00c070e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:02.396446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9d090-0e47-49d0-aa76-d9e9e00c070e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:02.405725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868ce5-a32d-446e-8148-88341810d7c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=c7fc75fab2e247ceaf897723c15023f9, role_id=143037337c76416d8ad332410c456159)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:02.407773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868ce5-a32d-446e-8148-88341810d7c0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:02.416676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 408/825] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:40:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:02.423689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9d090-0e47-49d0-aa76-d9e9e00c070e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:02.425279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 418/826] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:40:02 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/c7fc75fab2e247ceaf897723c15023f9/roles/143037337c76416d8ad332410c456159 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:40:02.513443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbc8a7-2c43-4940-b12d-93bc8aacaec0 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.514341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbc8a7-2c43-4940-b12d-93bc8aacaec0 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.514341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbc8a7-2c43-4940-b12d-93bc8aacaec0 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.516448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 419/827] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:02.522323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c166c7-f175-4636-958f-ccc95411a0b4 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.522559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c166c7-f175-4636-958f-ccc95411a0b4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.522765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c166c7-f175-4636-958f-ccc95411a0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.540840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d3c166c7-f175-4636-958f-ccc95411a0b4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:02.542218 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d3c166c7-f175-4636-958f-ccc95411a0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:02.562350 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9d090-0e47-49d0-aa76-d9e9e00c070e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:02.610394 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee28b7a-6c6c-4ca5-8218-6762b222e8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:02.612083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee28b7a-6c6c-4ca5-8218-6762b222e8c7 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.612616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee28b7a-6c6c-4ca5-8218-6762b222e8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.613098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee28b7a-6c6c-4ca5-8218-6762b222e8c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.642477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 420/828] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:02.682047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c166c7-f175-4636-958f-ccc95411a0b4 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:02.694379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee28b7a-6c6c-4ca5-8218-6762b222e8c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:02.695891 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee28b7a-6c6c-4ca5-8218-6762b222e8c7 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:02.816280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 409/829] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:02.817700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c166c7-f175-4636-958f-ccc95411a0b4 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:02.821735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee28b7a-6c6c-4ca5-8218-6762b222e8c7 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:02.858911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2d494-6fbd-445f-927b-2d22de9d45b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:02.860034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2d494-6fbd-445f-927b-2d22de9d45b1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.860324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2d494-6fbd-445f-927b-2d22de9d45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.860658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2d494-6fbd-445f-927b-2d22de9d45b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.880761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2d494-6fbd-445f-927b-2d22de9d45b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:02.889682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-1ad2d494-6fbd-445f-927b-2d22de9d45b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:40:02.891438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 421/830] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:02.897248 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2d494-6fbd-445f-927b-2d22de9d45b1 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:02.935869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee28b7a-6c6c-4ca5-8218-6762b222e8c7 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:02.971589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf636ce-388e-416f-866c-7af3a6a27e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:02.972807 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf636ce-388e-416f-866c-7af3a6a27e49 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:02.973315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf636ce-388e-416f-866c-7af3a6a27e49 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:02.973771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf636ce-388e-416f-866c-7af3a6a27e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:02.985033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf636ce-388e-416f-866c-7af3a6a27e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:02.986864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf636ce-388e-416f-866c-7af3a6a27e49 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:02.998511 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2d494-6fbd-445f-927b-2d22de9d45b1 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.005111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-baf636ce-388e-416f-866c-7af3a6a27e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:03.006888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 410/831] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:03.012372 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf636ce-388e-416f-866c-7af3a6a27e49 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:03.034730 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef1500-a75e-418a-8aba-9dc17f3dc1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:03.035410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1500-a75e-418a-8aba-9dc17f3dc1fb None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.035687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1500-a75e-418a-8aba-9dc17f3dc1fb None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.035958 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1500-a75e-418a-8aba-9dc17f3dc1fb None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.036715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef1500-a75e-418a-8aba-9dc17f3dc1fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:03.037017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef1500-a75e-418a-8aba-9dc17f3dc1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:03.038494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef1500-a75e-418a-8aba-9dc17f3dc1fb None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:03.047520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 422/832] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:03.053390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef1500-a75e-418a-8aba-9dc17f3dc1fb None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:03.135139 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf636ce-388e-416f-866c-7af3a6a27e49 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.160048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef1500-a75e-418a-8aba-9dc17f3dc1fb None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.178373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36b1b-ae18-4c06-b32e-abdbf05336ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:03.179422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36b1b-ae18-4c06-b32e-abdbf05336ba None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.179904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36b1b-ae18-4c06-b32e-abdbf05336ba None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.180352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36b1b-ae18-4c06-b32e-abdbf05336ba None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.181718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36b1b-ae18-4c06-b32e-abdbf05336ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:03.182261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36b1b-ae18-4c06-b32e-abdbf05336ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:03.184246 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36b1b-ae18-4c06-b32e-abdbf05336ba None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:03.196825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb276e-1b4f-4018-a902-7ca17878d02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:03.197659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb276e-1b4f-4018-a902-7ca17878d02d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.197939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb276e-1b4f-4018-a902-7ca17878d02d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.198241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb276e-1b4f-4018-a902-7ca17878d02d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.204021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 411/833] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:03.209534 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36b1b-ae18-4c06-b32e-abdbf05336ba None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:03.213119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb276e-1b4f-4018-a902-7ca17878d02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:03.214995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb276e-1b4f-4018-a902-7ca17878d02d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:03.233538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-9beb276e-1b4f-4018-a902-7ca17878d02d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:03.235510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 423/834] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:03.240814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb276e-1b4f-4018-a902-7ca17878d02d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:03.328500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36b1b-ae18-4c06-b32e-abdbf05336ba None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.341045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb276e-1b4f-4018-a902-7ca17878d02d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.371633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7438eb-109f-49a9-9db2-0ded0a16bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:03.372992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7438eb-109f-49a9-9db2-0ded0a16bf7f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.373472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7438eb-109f-49a9-9db2-0ded0a16bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.373923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b3c2-3f3e-41bc-9a16-0d6fedb78b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:03.374201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7438eb-109f-49a9-9db2-0ded0a16bf7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.374771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b3c2-3f3e-41bc-9a16-0d6fedb78b2d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.375048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b3c2-3f3e-41bc-9a16-0d6fedb78b2d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.375326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b3c2-3f3e-41bc-9a16-0d6fedb78b2d None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.376040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001b3c2-3f3e-41bc-9a16-0d6fedb78b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:03.376379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001b3c2-3f3e-41bc-9a16-0d6fedb78b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:03.377924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001b3c2-3f3e-41bc-9a16-0d6fedb78b2d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:03.383384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7438eb-109f-49a9-9db2-0ded0a16bf7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:03.385656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7438eb-109f-49a9-9db2-0ded0a16bf7f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:03.394340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 424/835] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:03.395788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b3c2-3f3e-41bc-9a16-0d6fedb78b2d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:03.402302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-7b7438eb-109f-49a9-9db2-0ded0a16bf7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:03.404417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 412/836] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:03.409548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7438eb-109f-49a9-9db2-0ded0a16bf7f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:03.496681 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b3c2-3f3e-41bc-9a16-0d6fedb78b2d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.522239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7438eb-109f-49a9-9db2-0ded0a16bf7f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.530296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b60d1-da6a-4c8e-a339-d05e72b23d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:03.531112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b60d1-da6a-4c8e-a339-d05e72b23d62 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.531812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b60d1-da6a-4c8e-a339-d05e72b23d62 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.531812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b60d1-da6a-4c8e-a339-d05e72b23d62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.539322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b60d1-da6a-4c8e-a339-d05e72b23d62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:03.540791 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b60d1-da6a-4c8e-a339-d05e72b23d62 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:03.558284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-e73b60d1-da6a-4c8e-a339-d05e72b23d62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:40:03.559104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1916b6-b323-47b0-9333-c53055b05bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:03.560052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1916b6-b323-47b0-9333-c53055b05bba None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.560542 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1916b6-b323-47b0-9333-c53055b05bba None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.561026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1916b6-b323-47b0-9333-c53055b05bba None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.562000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1916b6-b323-47b0-9333-c53055b05bba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:03.562536 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1916b6-b323-47b0-9333-c53055b05bba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:03.564275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1916b6-b323-47b0-9333-c53055b05bba None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:03.564380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 425/837] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:40:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:03.565177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b60d1-da6a-4c8e-a339-d05e72b23d62 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:03.577290 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 413/838] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:03.579053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342d7eb-f607-4256-bd62-8a304bfbbe4a None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.579646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342d7eb-f607-4256-bd62-8a304bfbbe4a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.580160 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342d7eb-f607-4256-bd62-8a304bfbbe4a None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.582355 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 414/839] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:03.583076 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342d7eb-f607-4256-bd62-8a304bfbbe4a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:03.665188 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b60d1-da6a-4c8e-a339-d05e72b23d62 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.691195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342d7eb-f607-4256-bd62-8a304bfbbe4a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.698298 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982a03a-c2b3-457f-8a52-c67e911e1bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:03.698986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982a03a-c2b3-457f-8a52-c67e911e1bfb None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.699264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982a03a-c2b3-457f-8a52-c67e911e1bfb None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.699596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982a03a-c2b3-457f-8a52-c67e911e1bfb None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.700440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982a03a-c2b3-457f-8a52-c67e911e1bfb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:03.700748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982a03a-c2b3-457f-8a52-c67e911e1bfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:03.702208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982a03a-c2b3-457f-8a52-c67e911e1bfb None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:03.720362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 426/840] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Oct 28 19:40:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:03.721898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0c7a4-2117-44d2-a102-0d06ad8a40e4 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.722270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0c7a4-2117-44d2-a102-0d06ad8a40e4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.722611 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0c7a4-2117-44d2-a102-0d06ad8a40e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.733388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99b25a-da20-4860-a597-7b85cd3daac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:03.734113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b25a-da20-4860-a597-7b85cd3daac5 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.734369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b25a-da20-4860-a597-7b85cd3daac5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.734647 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b25a-da20-4860-a597-7b85cd3daac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.735477 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99b25a-da20-4860-a597-7b85cd3daac5 None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=e91226b635934bfcb949577491791af4, user.id=be7be85d70b64273b7904082ee2ba848) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:03.735828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99b25a-da20-4860-a597-7b85cd3daac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:03.737324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99b25a-da20-4860-a597-7b85cd3daac5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:03.740756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b0a0c7a4-2117-44d2-a102-0d06ad8a40e4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:03.742128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b0a0c7a4-2117-44d2-a102-0d06ad8a40e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:03.754377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 415/841] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:03 2022] GET /identity/v3/role_assignments?user.id=be7be85d70b64273b7904082ee2ba848&scope.project.id=e91226b635934bfcb949577491791af4&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:03.754377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99b25a-da20-4860-a597-7b85cd3daac5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:03.840896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 427/842] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:03.857604 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99b25a-da20-4860-a597-7b85cd3daac5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.863121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0c7a4-2117-44d2-a102-0d06ad8a40e4 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:03.908338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d7770-e8c1-4004-8def-3e8c0915aaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:03.910124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d7770-e8c1-4004-8def-3e8c0915aaff None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:03.910650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d7770-e8c1-4004-8def-3e8c0915aaff None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:03.911149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d7770-e8c1-4004-8def-3e8c0915aaff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:03.979167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0c7a4-2117-44d2-a102-0d06ad8a40e4 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:03.994129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d7770-e8c1-4004-8def-3e8c0915aaff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:03.995628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d7770-e8c1-4004-8def-3e8c0915aaff None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:04.023456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26148531-1018-4c84-8ecd-9435cb295f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:04.024357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26148531-1018-4c84-8ecd-9435cb295f4e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:04.024696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26148531-1018-4c84-8ecd-9435cb295f4e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:04.025025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26148531-1018-4c84-8ecd-9435cb295f4e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:04.025745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26148531-1018-4c84-8ecd-9435cb295f4e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:04.027176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26148531-1018-4c84-8ecd-9435cb295f4e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:04.038314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-26148531-1018-4c84-8ecd-9435cb295f4e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:40:04.040431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 428/843] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:40:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:04.045757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26148531-1018-4c84-8ecd-9435cb295f4e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:04.120252 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 416/844] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:04.125124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d7770-e8c1-4004-8def-3e8c0915aaff None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:04.167384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26148531-1018-4c84-8ecd-9435cb295f4e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:04.202393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a00d1-c4f4-404f-b5f4-2180c3da6fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:04.202393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a00d1-c4f4-404f-b5f4-2180c3da6fb4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:04.202912 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a00d1-c4f4-404f-b5f4-2180c3da6fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:04.203281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a00d1-c4f4-404f-b5f4-2180c3da6fb4 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:04.204093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a00d1-c4f4-404f-b5f4-2180c3da6fb4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:04.204562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a00d1-c4f4-404f-b5f4-2180c3da6fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:04.206134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a00d1-c4f4-404f-b5f4-2180c3da6fb4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:04.215558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 429/845] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:40:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:04.217528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a00d1-c4f4-404f-b5f4-2180c3da6fb4 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:04.240600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d7770-e8c1-4004-8def-3e8c0915aaff None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:04.283639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796a325-4d7a-4701-9333-a6f50242614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:04.285074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a325-4d7a-4701-9333-a6f50242614d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:04.285459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a325-4d7a-4701-9333-a6f50242614d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:04.286019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a325-4d7a-4701-9333-a6f50242614d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:04.299242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796a325-4d7a-4701-9333-a6f50242614d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:04.301740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796a325-4d7a-4701-9333-a6f50242614d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:04.322326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-e796a325-4d7a-4701-9333-a6f50242614d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:04.324622 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 417/846] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:04.329805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796a325-4d7a-4701-9333-a6f50242614d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:04.335714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a00d1-c4f4-404f-b5f4-2180c3da6fb4 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:04.369276 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6c916-8d60-4bcf-b1fc-b76b39364fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:04.370345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6c916-8d60-4bcf-b1fc-b76b39364fcf None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:04.370841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6c916-8d60-4bcf-b1fc-b76b39364fcf None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:04.371310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6c916-8d60-4bcf-b1fc-b76b39364fcf None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:04.372207 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6c916-8d60-4bcf-b1fc-b76b39364fcf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:04.372700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6c916-8d60-4bcf-b1fc-b76b39364fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:04.374314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6c916-8d60-4bcf-b1fc-b76b39364fcf None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:04.379269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 430/847] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:40:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:04.458645 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796a325-4d7a-4701-9333-a6f50242614d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:04.497374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a246b93-13a0-47df-96c6-9755b18a248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:04.498631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a246b93-13a0-47df-96c6-9755b18a248a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:04.499112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a246b93-13a0-47df-96c6-9755b18a248a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:04.499633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a246b93-13a0-47df-96c6-9755b18a248a None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:04.500571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a246b93-13a0-47df-96c6-9755b18a248a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:04.501185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a246b93-13a0-47df-96c6-9755b18a248a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:04.503000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a246b93-13a0-47df-96c6-9755b18a248a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:04.516834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 418/848] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:04.523177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6c916-8d60-4bcf-b1fc-b76b39364fcf None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:04.632472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6c916-8d60-4bcf-b1fc-b76b39364fcf None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:04.668316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bd77c-19f5-4f16-a3de-0211a6d4e203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:04.669498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bd77c-19f5-4f16-a3de-0211a6d4e203 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:04.669982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bd77c-19f5-4f16-a3de-0211a6d4e203 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:04.670488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bd77c-19f5-4f16-a3de-0211a6d4e203 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:04.678139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bd77c-19f5-4f16-a3de-0211a6d4e203 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:04.679832 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bd77c-19f5-4f16-a3de-0211a6d4e203 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:04.695628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-dc3bd77c-19f5-4f16-a3de-0211a6d4e203 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:04.697529 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 431/849] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:04.703665 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a246b93-13a0-47df-96c6-9755b18a248a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:04.806398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a246b93-13a0-47df-96c6-9755b18a248a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:04.844346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35030d4f-b666-4ea2-8c19-37cdf3fcd81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:04.845080 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35030d4f-b666-4ea2-8c19-37cdf3fcd81f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:04.845365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35030d4f-b666-4ea2-8c19-37cdf3fcd81f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:04.845643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35030d4f-b666-4ea2-8c19-37cdf3fcd81f None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:04.846461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35030d4f-b666-4ea2-8c19-37cdf3fcd81f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:04.846769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35030d4f-b666-4ea2-8c19-37cdf3fcd81f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:04.848206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35030d4f-b666-4ea2-8c19-37cdf3fcd81f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:04.860573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 419/850] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:04.866438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bd77c-19f5-4f16-a3de-0211a6d4e203 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:04.959432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fe006-45f2-4260-9ab9-fd8a80ccf438 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:04.959758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fe006-45f2-4260-9ab9-fd8a80ccf438 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:04.960319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fe006-45f2-4260-9ab9-fd8a80ccf438 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:04.963075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 420/851] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:04.967641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48ad3e-4da0-4e44-b05d-0354d8eca199 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:04.968016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48ad3e-4da0-4e44-b05d-0354d8eca199 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:04.968387 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48ad3e-4da0-4e44-b05d-0354d8eca199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:04.968720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bd77c-19f5-4f16-a3de-0211a6d4e203 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:04.990110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-5f48ad3e-4da0-4e44-b05d-0354d8eca199 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:04.991765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5f48ad3e-4da0-4e44-b05d-0354d8eca199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:05.001863 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ca90-dd33-40d4-a42f-5e41329a6204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:05.002568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ca90-dd33-40d4-a42f-5e41329a6204 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:05.002848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ca90-dd33-40d4-a42f-5e41329a6204 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:05.003120 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ca90-dd33-40d4-a42f-5e41329a6204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:05.003946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ca90-dd33-40d4-a42f-5e41329a6204 None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=e91226b635934bfcb949577491791af4, user.id=720ff448eaea42aaa7e399e5b950b01e) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:05.004251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ca90-dd33-40d4-a42f-5e41329a6204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:05.005778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ca90-dd33-40d4-a42f-5e41329a6204 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:05.012009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 432/852] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:04 2022] GET /identity/v3/role_assignments?user.id=720ff448eaea42aaa7e399e5b950b01e&scope.project.id=e91226b635934bfcb949577491791af4&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:05.074949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 421/853] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:05.099844 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ca90-dd33-40d4-a42f-5e41329a6204 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:05.202701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ca90-dd33-40d4-a42f-5e41329a6204 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:05.243623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1a608-b940-45af-b7a4-49876f714eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:05.244440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a608-b940-45af-b7a4-49876f714eb5 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:05.244725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a608-b940-45af-b7a4-49876f714eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:05.244995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a608-b940-45af-b7a4-49876f714eb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:05.257240 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1a608-b940-45af-b7a4-49876f714eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:05.264402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-d1a1a608-b940-45af-b7a4-49876f714eb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:40:05.265977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 433/854] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:05.271922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48ad3e-4da0-4e44-b05d-0354d8eca199 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:05.372273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48ad3e-4da0-4e44-b05d-0354d8eca199 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:05.406716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191b84-246c-4ba3-b13f-668dd34895fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:05.407461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191b84-246c-4ba3-b13f-668dd34895fd None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:05.407745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191b84-246c-4ba3-b13f-668dd34895fd None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:05.408020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191b84-246c-4ba3-b13f-668dd34895fd None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:05.408774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191b84-246c-4ba3-b13f-668dd34895fd None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:05.409086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191b84-246c-4ba3-b13f-668dd34895fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:05.410497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191b84-246c-4ba3-b13f-668dd34895fd None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:05.419144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 422/855] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:40:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:05.425015 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1a608-b940-45af-b7a4-49876f714eb5 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:05.524388 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1a608-b940-45af-b7a4-49876f714eb5 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:05.557740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5b3a6-0de5-4efd-b295-251dc206d9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:05.559008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5b3a6-0de5-4efd-b295-251dc206d9c6 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:05.559494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5b3a6-0de5-4efd-b295-251dc206d9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:05.559950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5b3a6-0de5-4efd-b295-251dc206d9c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:05.572167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5b3a6-0de5-4efd-b295-251dc206d9c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:05.574005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5b3a6-0de5-4efd-b295-251dc206d9c6 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:05.591229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-18f5b3a6-0de5-4efd-b295-251dc206d9c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:05.593023 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 434/856] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:05.599039 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191b84-246c-4ba3-b13f-668dd34895fd None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:05.698985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191b84-246c-4ba3-b13f-668dd34895fd None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:05.732970 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15c4d-e202-4ee4-ab28-413cca2fa8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:05.733644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15c4d-e202-4ee4-ab28-413cca2fa8b8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:05.733924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15c4d-e202-4ee4-ab28-413cca2fa8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:05.734235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15c4d-e202-4ee4-ab28-413cca2fa8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:05.734965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff15c4d-e202-4ee4-ab28-413cca2fa8b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:05.735318 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff15c4d-e202-4ee4-ab28-413cca2fa8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:05.736816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff15c4d-e202-4ee4-ab28-413cca2fa8b8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:05.748885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 423/857] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:05.754293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5b3a6-0de5-4efd-b295-251dc206d9c6 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:05.852119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5b3a6-0de5-4efd-b295-251dc206d9c6 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:05.886928 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39a3ac-88aa-4d82-9eaa-c56d30de4ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:05.887782 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39a3ac-88aa-4d82-9eaa-c56d30de4ad8 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:05.888061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39a3ac-88aa-4d82-9eaa-c56d30de4ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:05.888629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39a3ac-88aa-4d82-9eaa-c56d30de4ad8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:05.897920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39a3ac-88aa-4d82-9eaa-c56d30de4ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:05.899352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39a3ac-88aa-4d82-9eaa-c56d30de4ad8 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:05.914337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-aa39a3ac-88aa-4d82-9eaa-c56d30de4ad8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:40:05.915941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 435/858] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Oct 28 19:40:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:05.921725 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15c4d-e202-4ee4-ab28-413cca2fa8b8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:06.023354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15c4d-e202-4ee4-ab28-413cca2fa8b8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:06.057399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac234af-403d-4702-af82-1d78acf6173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:06.058110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac234af-403d-4702-af82-1d78acf6173d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.058392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac234af-403d-4702-af82-1d78acf6173d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.058664 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac234af-403d-4702-af82-1d78acf6173d None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.059497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac234af-403d-4702-af82-1d78acf6173d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:06.059798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac234af-403d-4702-af82-1d78acf6173d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:06.061240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac234af-403d-4702-af82-1d78acf6173d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:06.079047 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 424/859] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Oct 28 19:40:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:06.084444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39a3ac-88aa-4d82-9eaa-c56d30de4ad8 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:06.183024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39a3ac-88aa-4d82-9eaa-c56d30de4ad8 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:06.216274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d97a-6139-4d28-b225-2a8ad9a6e903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:06.216938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d97a-6139-4d28-b225-2a8ad9a6e903 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.217215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d97a-6139-4d28-b225-2a8ad9a6e903 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.217482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d97a-6139-4d28-b225-2a8ad9a6e903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.241504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200595-6405-431f-8bdb-979e15b46993 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.241950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200595-6405-431f-8bdb-979e15b46993 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.242274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200595-6405-431f-8bdb-979e15b46993 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.246510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 425/860] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:06.250359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55df0-767c-4c9c-8a57-50c1e107a1aa None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.250715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55df0-767c-4c9c-8a57-50c1e107a1aa None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.251128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55df0-767c-4c9c-8a57-50c1e107a1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.271299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e5b55df0-767c-4c9c-8a57-50c1e107a1aa None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:06.272604 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e5b55df0-767c-4c9c-8a57-50c1e107a1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:06.291974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028d97a-6139-4d28-b225-2a8ad9a6e903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:06.293597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028d97a-6139-4d28-b225-2a8ad9a6e903 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:06.357427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 426/861] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:06.379123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b55df0-767c-4c9c-8a57-50c1e107a1aa None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:06.403113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 436/862] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:06.408469 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d97a-6139-4d28-b225-2a8ad9a6e903 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:06.498911 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b55df0-767c-4c9c-8a57-50c1e107a1aa None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:06.535064 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d97a-6139-4d28-b225-2a8ad9a6e903 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:06.544055 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56d83e-b6de-4626-90e9-630b188730fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:06.545208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56d83e-b6de-4626-90e9-630b188730fa None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.546020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56d83e-b6de-4626-90e9-630b188730fa None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.546509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56d83e-b6de-4626-90e9-630b188730fa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.548481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56d83e-b6de-4626-90e9-630b188730fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:06.550279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56d83e-b6de-4626-90e9-630b188730fa None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:06.565867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-3f56d83e-b6de-4626-90e9-630b188730fa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:40:06.568112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 427/863] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Oct 28 19:40:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:06.573496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8883e8-22c2-4c65-83bd-6e9846b11258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:06.574374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8883e8-22c2-4c65-83bd-6e9846b11258 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.574657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8883e8-22c2-4c65-83bd-6e9846b11258 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.574928 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8883e8-22c2-4c65-83bd-6e9846b11258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.576308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56d83e-b6de-4626-90e9-630b188730fa None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:06.586903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8883e8-22c2-4c65-83bd-6e9846b11258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:06.588373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8883e8-22c2-4c65-83bd-6e9846b11258 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:06.607676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-da8883e8-22c2-4c65-83bd-6e9846b11258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:06.609214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 437/864] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:06.614836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8883e8-22c2-4c65-83bd-6e9846b11258 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:06.701041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56d83e-b6de-4626-90e9-630b188730fa None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:06.733089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8883e8-22c2-4c65-83bd-6e9846b11258 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:06.735202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8753ec-4666-497e-8053-e42cc4f14a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:06.736089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8753ec-4666-497e-8053-e42cc4f14a3d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.736572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8753ec-4666-497e-8053-e42cc4f14a3d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.737030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8753ec-4666-497e-8053-e42cc4f14a3d None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.737928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8753ec-4666-497e-8053-e42cc4f14a3d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:06.738447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8753ec-4666-497e-8053-e42cc4f14a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:06.740009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8753ec-4666-497e-8053-e42cc4f14a3d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:06.745002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 428/865] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:06.751474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8753ec-4666-497e-8053-e42cc4f14a3d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:06.773763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81966806-34a0-4701-909a-5ce38cb94456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:06.775146 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81966806-34a0-4701-909a-5ce38cb94456 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.775628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81966806-34a0-4701-909a-5ce38cb94456 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.776078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81966806-34a0-4701-909a-5ce38cb94456 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.777053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81966806-34a0-4701-909a-5ce38cb94456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:06.777538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81966806-34a0-4701-909a-5ce38cb94456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:06.779299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81966806-34a0-4701-909a-5ce38cb94456 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:06.795613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 438/866] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:06.796832 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81966806-34a0-4701-909a-5ce38cb94456 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:06.854904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8753ec-4666-497e-8053-e42cc4f14a3d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:06.887279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7d53-8c8c-434a-895f-724676b6dda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:06.887949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7d53-8c8c-434a-895f-724676b6dda9 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.888223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7d53-8c8c-434a-895f-724676b6dda9 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.888494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7d53-8c8c-434a-895f-724676b6dda9 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.889198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7d53-8c8c-434a-895f-724676b6dda9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:06.889496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7d53-8c8c-434a-895f-724676b6dda9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:06.890889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7d53-8c8c-434a-895f-724676b6dda9 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:06.894849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81966806-34a0-4701-909a-5ce38cb94456 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:06.895462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 429/867] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:06.896683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a5ae-0777-41b0-99bb-3bf42dd0e2fc None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.896960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a5ae-0777-41b0-99bb-3bf42dd0e2fc None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.897231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a5ae-0777-41b0-99bb-3bf42dd0e2fc None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.899371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 430/868] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:06.904976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43b6c0-c6a1-4f01-85b4-fbe8708cbc40 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.905529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43b6c0-c6a1-4f01-85b4-fbe8708cbc40 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.906003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43b6c0-c6a1-4f01-85b4-fbe8708cbc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.928063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-5e43b6c0-c6a1-4f01-85b4-fbe8708cbc40 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:06.930307 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5e43b6c0-c6a1-4f01-85b4-fbe8708cbc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:06.937588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95161b1-277f-415a-86aa-533b687782d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:06.938580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95161b1-277f-415a-86aa-533b687782d4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:06.938856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95161b1-277f-415a-86aa-533b687782d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:06.939122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95161b1-277f-415a-86aa-533b687782d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:06.947001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95161b1-277f-415a-86aa-533b687782d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:06.948478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95161b1-277f-415a-86aa-533b687782d4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:06.963081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c95161b1-277f-415a-86aa-533b687782d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:06.969290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 439/869] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:06.970443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95161b1-277f-415a-86aa-533b687782d4 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:07.021675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 431/870] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:07.039863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43b6c0-c6a1-4f01-85b4-fbe8708cbc40 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:07.091664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95161b1-277f-415a-86aa-533b687782d4 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:07.135417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbad3a-d504-4b93-813c-32c347f3839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:07.136115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbad3a-d504-4b93-813c-32c347f3839e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:07.136394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbad3a-d504-4b93-813c-32c347f3839e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:07.136734 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbad3a-d504-4b93-813c-32c347f3839e None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:07.137552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbad3a-d504-4b93-813c-32c347f3839e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:07.137858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbad3a-d504-4b93-813c-32c347f3839e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:07.139430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbad3a-d504-4b93-813c-32c347f3839e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:07.152590 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43b6c0-c6a1-4f01-85b4-fbe8708cbc40 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:07.153126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 440/871] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:07.159190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbad3a-d504-4b93-813c-32c347f3839e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:07.192256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6ce2c-fa6b-4e1c-a723-57bb29d677ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:07.193297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ce2c-fa6b-4e1c-a723-57bb29d677ec None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:07.193754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ce2c-fa6b-4e1c-a723-57bb29d677ec None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:07.194226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ce2c-fa6b-4e1c-a723-57bb29d677ec None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:07.195140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6ce2c-fa6b-4e1c-a723-57bb29d677ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:07.196720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6ce2c-fa6b-4e1c-a723-57bb29d677ec None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:07.212204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 432/872] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:40:07 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:07.290390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbad3a-d504-4b93-813c-32c347f3839e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:07.333305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6778be-3b1d-490e-b8ae-4f59682a4177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:07.333985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6778be-3b1d-490e-b8ae-4f59682a4177 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:07.334297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6778be-3b1d-490e-b8ae-4f59682a4177 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:07.334573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6778be-3b1d-490e-b8ae-4f59682a4177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:07.335427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6778be-3b1d-490e-b8ae-4f59682a4177 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=c7fc75fab2e247ceaf897723c15023f9) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:07.335735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6778be-3b1d-490e-b8ae-4f59682a4177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:07.337206 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6778be-3b1d-490e-b8ae-4f59682a4177 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:07.344299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 441/873] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:07 2022] GET /identity/v3/role_assignments?user.id=c7fc75fab2e247ceaf897723c15023f9&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:07.524992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93860eaf-ee25-4c58-952d-a9b9720c069b None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:07.525366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93860eaf-ee25-4c58-952d-a9b9720c069b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:07.525554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93860eaf-ee25-4c58-952d-a9b9720c069b None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:07.527625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 433/874] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:07.533403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4ecbc-9dcd-49c7-9a06-40d03803945e None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:07.533691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4ecbc-9dcd-49c7-9a06-40d03803945e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:07.533976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4ecbc-9dcd-49c7-9a06-40d03803945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:07.552707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-9ab4ecbc-9dcd-49c7-9a06-40d03803945e None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:07.553849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9ab4ecbc-9dcd-49c7-9a06-40d03803945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:07.623193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 442/875] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:07.644961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93860eaf-ee25-4c58-952d-a9b9720c069b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:07.750675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93860eaf-ee25-4c58-952d-a9b9720c069b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:07.784923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b70f0-61fc-48e2-99b7-9ee49174c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:07.785744 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b70f0-61fc-48e2-99b7-9ee49174c1ff None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:07.786028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b70f0-61fc-48e2-99b7-9ee49174c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:07.786328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b70f0-61fc-48e2-99b7-9ee49174c1ff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:07.787118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b70f0-61fc-48e2-99b7-9ee49174c1ff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:07.788548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b70f0-61fc-48e2-99b7-9ee49174c1ff None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:07.800782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-8e5b70f0-61fc-48e2-99b7-9ee49174c1ff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:40:07.802402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 434/876] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:07.808258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4ecbc-9dcd-49c7-9a06-40d03803945e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:07.902552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4ecbc-9dcd-49c7-9a06-40d03803945e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:07.939521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334313-b30f-48ee-b42c-24fc6ae9799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:07.940196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334313-b30f-48ee-b42c-24fc6ae9799e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:07.940475 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334313-b30f-48ee-b42c-24fc6ae9799e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:07.940743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334313-b30f-48ee-b42c-24fc6ae9799e None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:07.941455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b334313-b30f-48ee-b42c-24fc6ae9799e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:07.941754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b334313-b30f-48ee-b42c-24fc6ae9799e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:07.943190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b334313-b30f-48ee-b42c-24fc6ae9799e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:07.948153 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 443/877] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Oct 28 19:40:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:07.953652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b70f0-61fc-48e2-99b7-9ee49174c1ff None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:08.053961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b70f0-61fc-48e2-99b7-9ee49174c1ff None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:08.087626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f7ab1-e48c-4aeb-936c-3abc8537d87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:08.088219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f7ab1-e48c-4aeb-936c-3abc8537d87b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:08.088498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f7ab1-e48c-4aeb-936c-3abc8537d87b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:08.088768 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f7ab1-e48c-4aeb-936c-3abc8537d87b None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:08.089471 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f7ab1-e48c-4aeb-936c-3abc8537d87b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:08.089772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f7ab1-e48c-4aeb-936c-3abc8537d87b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:08.091192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f7ab1-e48c-4aeb-936c-3abc8537d87b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:08.097164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 435/878] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Oct 28 19:40:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:09.367092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d4ae-90be-441c-be68-fb1473cd33db None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:09.367615 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d4ae-90be-441c-be68-fb1473cd33db None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:09.367724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d4ae-90be-441c-be68-fb1473cd33db None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:09.369685 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 444/879] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:09.375109 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d905-f4aa-41f6-9f36-e322e8019387 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:09.375963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d905-f4aa-41f6-9f36-e322e8019387 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:09.376461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d905-f4aa-41f6-9f36-e322e8019387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:09.394451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c986d905-f4aa-41f6-9f36-e322e8019387 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:09.395921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c986d905-f4aa-41f6-9f36-e322e8019387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:09.464628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 436/880] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:09.488902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d4ae-90be-441c-be68-fb1473cd33db None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:09.591047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d4ae-90be-441c-be68-fb1473cd33db None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:09.625283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437d859-f26e-4528-a32a-c0b2116027bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:09.626343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437d859-f26e-4528-a32a-c0b2116027bc None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:09.626824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437d859-f26e-4528-a32a-c0b2116027bc None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:09.627286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437d859-f26e-4528-a32a-c0b2116027bc None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:09.628212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437d859-f26e-4528-a32a-c0b2116027bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:09.629806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437d859-f26e-4528-a32a-c0b2116027bc None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:09.636638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd13fa-af86-4dcc-81ef-7dbc843c07d1 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:09.642576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd13fa-af86-4dcc-81ef-7dbc843c07d1 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:09.643058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd13fa-af86-4dcc-81ef-7dbc843c07d1 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:09.645746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 437/881] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:09.655016 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 445/882] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:40:09 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:09.655180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2d0ec-debf-4eb1-99c1-cf9332cfde2b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:09.662325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2d0ec-debf-4eb1-99c1-cf9332cfde2b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:09.662325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2d0ec-debf-4eb1-99c1-cf9332cfde2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:09.683632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d5a2d0ec-debf-4eb1-99c1-cf9332cfde2b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:09.685113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d5a2d0ec-debf-4eb1-99c1-cf9332cfde2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:09.774192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 438/883] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:09.792601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437d859-f26e-4528-a32a-c0b2116027bc None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:09.820283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035016b4-4507-4172-9394-18e478b994ce None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:09.820581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035016b4-4507-4172-9394-18e478b994ce None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:09.820855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035016b4-4507-4172-9394-18e478b994ce None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:09.822995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 439/884] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:09.828673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171b6d-1c42-48c7-9159-1ff5e200d788 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:09.828952 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171b6d-1c42-48c7-9159-1ff5e200d788 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:09.829227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171b6d-1c42-48c7-9159-1ff5e200d788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:09.851765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-7b171b6d-1c42-48c7-9159-1ff5e200d788 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:09.853145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7b171b6d-1c42-48c7-9159-1ff5e200d788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:09.911362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437d859-f26e-4528-a32a-c0b2116027bc None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:09.932404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 440/885] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:09.947047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef746a-ee7d-4bd3-bfad-237e7b951d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:09.947869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef746a-ee7d-4bd3-bfad-237e7b951d9d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:09.948152 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef746a-ee7d-4bd3-bfad-237e7b951d9d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:09.948427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef746a-ee7d-4bd3-bfad-237e7b951d9d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:09.949092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef746a-ee7d-4bd3-bfad-237e7b951d9d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:09.950574 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef746a-ee7d-4bd3-bfad-237e7b951d9d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:09.955872 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171b6d-1c42-48c7-9159-1ff5e200d788 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:09.962092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-16ef746a-ee7d-4bd3-bfad-237e7b951d9d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:40:09.963628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 446/886] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:40:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:09.971102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef746a-ee7d-4bd3-bfad-237e7b951d9d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:10.057267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171b6d-1c42-48c7-9159-1ff5e200d788 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:10.069395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef746a-ee7d-4bd3-bfad-237e7b951d9d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:10.094060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e337e-1e5f-478e-bd30-da53d6f010e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:10.095277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e337e-1e5f-478e-bd30-da53d6f010e8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.095757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e337e-1e5f-478e-bd30-da53d6f010e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.096230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e337e-1e5f-478e-bd30-da53d6f010e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.105593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1134a88-a3e8-4c03-b9ae-df6253b94cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:10.106508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1134a88-a3e8-4c03-b9ae-df6253b94cd9 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.106639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1134a88-a3e8-4c03-b9ae-df6253b94cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.106846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1134a88-a3e8-4c03-b9ae-df6253b94cd9 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.107570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1134a88-a3e8-4c03-b9ae-df6253b94cd9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:10.107871 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1134a88-a3e8-4c03-b9ae-df6253b94cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:10.109275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1134a88-a3e8-4c03-b9ae-df6253b94cd9 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:10.110786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e337e-1e5f-478e-bd30-da53d6f010e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:10.118654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-064e337e-1e5f-478e-bd30-da53d6f010e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:40:10.119414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 447/887] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:40:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:10.125271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 441/888] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Oct 28 19:40:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:10.125432 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1134a88-a3e8-4c03-b9ae-df6253b94cd9 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:10.126855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e337e-1e5f-478e-bd30-da53d6f010e8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:10.242371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1134a88-a3e8-4c03-b9ae-df6253b94cd9 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:10.248923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e337e-1e5f-478e-bd30-da53d6f010e8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:10.275452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fd835-b181-43d7-8170-4a4c39a2834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:10.276472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fd835-b181-43d7-8170-4a4c39a2834c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.276472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fd835-b181-43d7-8170-4a4c39a2834c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.276875 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fd835-b181-43d7-8170-4a4c39a2834c None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.277652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fd835-b181-43d7-8170-4a4c39a2834c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:10.278022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fd835-b181-43d7-8170-4a4c39a2834c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:10.279482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fd835-b181-43d7-8170-4a4c39a2834c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:10.289113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 448/889] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:40:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:10.290219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fd835-b181-43d7-8170-4a4c39a2834c None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:10.293469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a58a2-6224-44bf-8fa6-c16ac1097e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:10.294369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a58a2-6224-44bf-8fa6-c16ac1097e85 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.294837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a58a2-6224-44bf-8fa6-c16ac1097e85 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.295286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a58a2-6224-44bf-8fa6-c16ac1097e85 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.296208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a58a2-6224-44bf-8fa6-c16ac1097e85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:10.297088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a58a2-6224-44bf-8fa6-c16ac1097e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:10.298755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a58a2-6224-44bf-8fa6-c16ac1097e85 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:10.312410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 442/890] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Oct 28 19:40:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:10.313609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a58a2-6224-44bf-8fa6-c16ac1097e85 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:10.387676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fd835-b181-43d7-8170-4a4c39a2834c None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:10.417654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a58a2-6224-44bf-8fa6-c16ac1097e85 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:10.421391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5adcdf-97a2-4932-951c-4291dfd0be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:10.421527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5adcdf-97a2-4932-951c-4291dfd0be0e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.422232 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5adcdf-97a2-4932-951c-4291dfd0be0e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.422507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5adcdf-97a2-4932-951c-4291dfd0be0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.423306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5adcdf-97a2-4932-951c-4291dfd0be0e None admin] RBAC: Adding query filter params (interface=public, service_id=42943d5878344d2285acb257281fd0e8, region_id=RegionOne) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:10.423610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5adcdf-97a2-4932-951c-4291dfd0be0e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:10.425061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5adcdf-97a2-4932-951c-4291dfd0be0e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:10.435026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 449/891] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Oct 28 19:40:10 2022] GET /identity/v3/endpoints?service_id=42943d5878344d2285acb257281fd0e8&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:10.436045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5adcdf-97a2-4932-951c-4291dfd0be0e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:10.461910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be6932-5df0-45e4-9f64-006969ef08fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:10.462756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6932-5df0-45e4-9f64-006969ef08fe None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.463036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6932-5df0-45e4-9f64-006969ef08fe None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.463307 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6932-5df0-45e4-9f64-006969ef08fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.474687 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be6932-5df0-45e4-9f64-006969ef08fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:10.476143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be6932-5df0-45e4-9f64-006969ef08fe None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:10.492228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-b0be6932-5df0-45e4-9f64-006969ef08fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:10.498070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 443/892] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:10.498070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553d101-70d5-4db7-b650-ca1a74428079 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.498070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553d101-70d5-4db7-b650-ca1a74428079 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.498070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553d101-70d5-4db7-b650-ca1a74428079 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.498070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 444/893] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:10.499891 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553d101-70d5-4db7-b650-ca1a74428079 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:10.542451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5adcdf-97a2-4932-951c-4291dfd0be0e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:10.577850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af793f1c-42d3-46a1-b205-c4ed9e217978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:10.578739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793f1c-42d3-46a1-b205-c4ed9e217978 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.579114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793f1c-42d3-46a1-b205-c4ed9e217978 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.579506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793f1c-42d3-46a1-b205-c4ed9e217978 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.580289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af793f1c-42d3-46a1-b205-c4ed9e217978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:10.581773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af793f1c-42d3-46a1-b205-c4ed9e217978 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:10.587459 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 450/894] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Oct 28 19:40:10 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:40:10.600260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69e75f-cd36-4bc5-9c8b-eb69066545b3 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.600635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69e75f-cd36-4bc5-9c8b-eb69066545b3 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.600974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69e75f-cd36-4bc5-9c8b-eb69066545b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.608853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553d101-70d5-4db7-b650-ca1a74428079 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:10.623231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-8e69e75f-cd36-4bc5-9c8b-eb69066545b3 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:10.625371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8e69e75f-cd36-4bc5-9c8b-eb69066545b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:10.660714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3f6d3-2266-496a-bdea-7aa17378dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:10.661913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3f6d3-2266-496a-bdea-7aa17378dd37 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.662403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3f6d3-2266-496a-bdea-7aa17378dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.662904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3f6d3-2266-496a-bdea-7aa17378dd37 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.663816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3f6d3-2266-496a-bdea-7aa17378dd37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:10.664607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3f6d3-2266-496a-bdea-7aa17378dd37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:10.666297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3f6d3-2266-496a-bdea-7aa17378dd37 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:10.680807 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 445/895] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:10.687805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3f6d3-2266-496a-bdea-7aa17378dd37 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:10.720838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 451/896] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:10.741384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69e75f-cd36-4bc5-9c8b-eb69066545b3 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:10.799974 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3f6d3-2266-496a-bdea-7aa17378dd37 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:10.838535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df7d1c-0471-465b-9ec1-c43e389aeea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:10.839892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7d1c-0471-465b-9ec1-c43e389aeea3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.840412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7d1c-0471-465b-9ec1-c43e389aeea3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.840869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7d1c-0471-465b-9ec1-c43e389aeea3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.850863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df7d1c-0471-465b-9ec1-c43e389aeea3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:10.853012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df7d1c-0471-465b-9ec1-c43e389aeea3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:10.858956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69e75f-cd36-4bc5-9c8b-eb69066545b3 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:10.869269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-31df7d1c-0471-465b-9ec1-c43e389aeea3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:40:10.870985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 446/897] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Oct 28 19:40:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:10.876646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df7d1c-0471-465b-9ec1-c43e389aeea3 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:10.900760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1da10d-3861-497b-9d27-32e996a4a60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:10.901604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1da10d-3861-497b-9d27-32e996a4a60c None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:10.901986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1da10d-3861-497b-9d27-32e996a4a60c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:10.902370 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1da10d-3861-497b-9d27-32e996a4a60c None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:10.903297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1da10d-3861-497b-9d27-32e996a4a60c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:10.905049 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1da10d-3861-497b-9d27-32e996a4a60c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:10.930130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 452/898] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:40:10 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:40:10.993499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df7d1c-0471-465b-9ec1-c43e389aeea3 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:11.037172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8586df-a4bf-4308-a5e6-2552cb56ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:11.037857 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8586df-a4bf-4308-a5e6-2552cb56ce22 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:11.038204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8586df-a4bf-4308-a5e6-2552cb56ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:11.038484 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8586df-a4bf-4308-a5e6-2552cb56ce22 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:11.039402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8586df-a4bf-4308-a5e6-2552cb56ce22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:11.039714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8586df-a4bf-4308-a5e6-2552cb56ce22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:11.041371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8586df-a4bf-4308-a5e6-2552cb56ce22 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:11.062071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 447/899] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Oct 28 19:40:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:11.067901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1da10d-3861-497b-9d27-32e996a4a60c None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:11.170748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1da10d-3861-497b-9d27-32e996a4a60c None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:11.203917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ed43-ed2e-405c-964f-fe048b83cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:11.204576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ed43-ed2e-405c-964f-fe048b83cf26 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:11.204859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ed43-ed2e-405c-964f-fe048b83cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:11.205131 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ed43-ed2e-405c-964f-fe048b83cf26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:11.274565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72ed43-ed2e-405c-964f-fe048b83cf26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:11.276050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72ed43-ed2e-405c-964f-fe048b83cf26 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:11.373830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 453/900] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:11 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:11.379658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8586df-a4bf-4308-a5e6-2552cb56ce22 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:11.477283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8586df-a4bf-4308-a5e6-2552cb56ce22 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:11.511195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed30d6-0277-4391-b467-56f83639f957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:11.512350 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed30d6-0277-4391-b467-56f83639f957 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:11.512816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed30d6-0277-4391-b467-56f83639f957 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:11.513316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed30d6-0277-4391-b467-56f83639f957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:11.523627 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed30d6-0277-4391-b467-56f83639f957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:11.525326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed30d6-0277-4391-b467-56f83639f957 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:11.542896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-fbed30d6-0277-4391-b467-56f83639f957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:11.544697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 448/901] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:11.550939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ed43-ed2e-405c-964f-fe048b83cf26 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:11.648659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ed43-ed2e-405c-964f-fe048b83cf26 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:11.684404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936aa93-1f74-4930-9eb7-d5716b199311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:11.685076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936aa93-1f74-4930-9eb7-d5716b199311 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:11.685349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936aa93-1f74-4930-9eb7-d5716b199311 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:11.685614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936aa93-1f74-4930-9eb7-d5716b199311 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:11.686360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936aa93-1f74-4930-9eb7-d5716b199311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:11.686704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936aa93-1f74-4930-9eb7-d5716b199311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:11.688151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936aa93-1f74-4930-9eb7-d5716b199311 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:11.700257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 454/902] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:11.705894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed30d6-0277-4391-b467-56f83639f957 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:11.813088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed30d6-0277-4391-b467-56f83639f957 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:11.846370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9608701-0d21-4954-b266-6f65a0b9dc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:11.847173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9608701-0d21-4954-b266-6f65a0b9dc18 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:11.847453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9608701-0d21-4954-b266-6f65a0b9dc18 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:11.847712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9608701-0d21-4954-b266-6f65a0b9dc18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:11.854791 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9608701-0d21-4954-b266-6f65a0b9dc18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:11.856246 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9608701-0d21-4954-b266-6f65a0b9dc18 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:11.869493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a9608701-0d21-4954-b266-6f65a0b9dc18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:11.871047 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 449/903] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:11.877020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936aa93-1f74-4930-9eb7-d5716b199311 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:11.977780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936aa93-1f74-4930-9eb7-d5716b199311 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:12.010873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3486f-f72e-4252-a01c-3a45ec61a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:12.011541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3486f-f72e-4252-a01c-3a45ec61a2ba None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:12.011820 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3486f-f72e-4252-a01c-3a45ec61a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:12.012090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3486f-f72e-4252-a01c-3a45ec61a2ba None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:12.012879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3486f-f72e-4252-a01c-3a45ec61a2ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:12.013188 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3486f-f72e-4252-a01c-3a45ec61a2ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:12.014752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3486f-f72e-4252-a01c-3a45ec61a2ba None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:12.032142 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 455/904] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:12.033559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9608701-0d21-4954-b266-6f65a0b9dc18 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:12.133868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92daa52-77cb-4d8c-b639-34b45d5d36d6 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:12.134523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92daa52-77cb-4d8c-b639-34b45d5d36d6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:12.135014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92daa52-77cb-4d8c-b639-34b45d5d36d6 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:12.141441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 456/905] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:12.141867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9608701-0d21-4954-b266-6f65a0b9dc18 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:12.143496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89764285-e312-4b96-b795-bf2781c4f403 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:12.143738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89764285-e312-4b96-b795-bf2781c4f403 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:12.144009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89764285-e312-4b96-b795-bf2781c4f403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:12.168619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-89764285-e312-4b96-b795-bf2781c4f403 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:12.170889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-89764285-e312-4b96-b795-bf2781c4f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:12.179102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04f93a-86cc-4b00-beec-54b2d20d80d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:12.179781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04f93a-86cc-4b00-beec-54b2d20d80d8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:12.180063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04f93a-86cc-4b00-beec-54b2d20d80d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:12.180336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04f93a-86cc-4b00-beec-54b2d20d80d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:12.181176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04f93a-86cc-4b00-beec-54b2d20d80d8 None admin] RBAC: Adding query filter params (role.id=5d9f5b21f518437b9d6a33ac52315fb6, scope.project.id=e91226b635934bfcb949577491791af4, user.id=c7fc75fab2e247ceaf897723c15023f9) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:12.181486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04f93a-86cc-4b00-beec-54b2d20d80d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:12.183020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04f93a-86cc-4b00-beec-54b2d20d80d8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:12.190132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 450/906] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:12 2022] GET /identity/v3/role_assignments?user.id=c7fc75fab2e247ceaf897723c15023f9&scope.project.id=e91226b635934bfcb949577491791af4&role.id=5d9f5b21f518437b9d6a33ac52315fb6 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:12.252970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 457/907] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:12.276476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04f93a-86cc-4b00-beec-54b2d20d80d8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:12.383157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04f93a-86cc-4b00-beec-54b2d20d80d8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:12.417839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520644f1-1df0-4642-a8ff-570bab8f0df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:12.418711 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520644f1-1df0-4642-a8ff-570bab8f0df3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:12.418988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520644f1-1df0-4642-a8ff-570bab8f0df3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:12.419258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520644f1-1df0-4642-a8ff-570bab8f0df3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:12.419920 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520644f1-1df0-4642-a8ff-570bab8f0df3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:12.421683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520644f1-1df0-4642-a8ff-570bab8f0df3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:12.433359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-520644f1-1df0-4642-a8ff-570bab8f0df3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:40:12.439677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 451/908] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Oct 28 19:40:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:12.441108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89764285-e312-4b96-b795-bf2781c4f403 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:12.538188 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89764285-e312-4b96-b795-bf2781c4f403 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:12.576640 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b32bc3-4394-44ee-b1dc-eff5f8506923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:12.578166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b32bc3-4394-44ee-b1dc-eff5f8506923 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:12.578753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b32bc3-4394-44ee-b1dc-eff5f8506923 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:12.579245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b32bc3-4394-44ee-b1dc-eff5f8506923 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:12.580171 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b32bc3-4394-44ee-b1dc-eff5f8506923 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:12.580670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b32bc3-4394-44ee-b1dc-eff5f8506923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:12.582289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b32bc3-4394-44ee-b1dc-eff5f8506923 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:12.592521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 458/909] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:12.594316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520644f1-1df0-4642-a8ff-570bab8f0df3 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:12.697393 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520644f1-1df0-4642-a8ff-570bab8f0df3 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:12.730467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758f051-548b-4fa6-b723-378ae1054126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:12.731146 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758f051-548b-4fa6-b723-378ae1054126 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:12.731420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758f051-548b-4fa6-b723-378ae1054126 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:12.731693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758f051-548b-4fa6-b723-378ae1054126 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:12.732403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758f051-548b-4fa6-b723-378ae1054126 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:12.732708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758f051-548b-4fa6-b723-378ae1054126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:12.734184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758f051-548b-4fa6-b723-378ae1054126 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:12.744406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 452/910] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:12.745818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b32bc3-4394-44ee-b1dc-eff5f8506923 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:12.848103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b32bc3-4394-44ee-b1dc-eff5f8506923 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:12.881419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925330b-dc70-4dc0-826c-4f76f46899bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:12.882111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925330b-dc70-4dc0-826c-4f76f46899bb None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:12.882398 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925330b-dc70-4dc0-826c-4f76f46899bb None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:12.882670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925330b-dc70-4dc0-826c-4f76f46899bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:12.883463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925330b-dc70-4dc0-826c-4f76f46899bb None admin] RBAC: Adding query filter params (interface=public, service_id=6616f2805e4b47d2bfe99ce9fa4701e5, region_id=RegionOne) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:12.883767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925330b-dc70-4dc0-826c-4f76f46899bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:12.885145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925330b-dc70-4dc0-826c-4f76f46899bb None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:12.894224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 459/911] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Oct 28 19:40:12 2022] GET /identity/v3/endpoints?service_id=6616f2805e4b47d2bfe99ce9fa4701e5&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:12.896409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758f051-548b-4fa6-b723-378ae1054126 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:12.980062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63eaf-907e-4e74-b628-f6ccc33ac2c6 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:12.980416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63eaf-907e-4e74-b628-f6ccc33ac2c6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:12.980605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f63eaf-907e-4e74-b628-f6ccc33ac2c6 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:12.982819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 460/912] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:12.987950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe518ddd-27d5-4e0f-bd5e-000b365e32a2 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:12.988593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe518ddd-27d5-4e0f-bd5e-000b365e32a2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:12.989127 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe518ddd-27d5-4e0f-bd5e-000b365e32a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:12.999705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758f051-548b-4fa6-b723-378ae1054126 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:13.012780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fe518ddd-27d5-4e0f-bd5e-000b365e32a2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:13.014965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fe518ddd-27d5-4e0f-bd5e-000b365e32a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:13.035104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f43343-f9f3-4425-9665-75427e571e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:13.035776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f43343-f9f3-4425-9665-75427e571e44 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:13.036044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f43343-f9f3-4425-9665-75427e571e44 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:13.036311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f43343-f9f3-4425-9665-75427e571e44 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:13.037021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f43343-f9f3-4425-9665-75427e571e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:13.038447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f43343-f9f3-4425-9665-75427e571e44 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:13.044982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 453/913] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Oct 28 19:40:12 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:40:13.104452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 461/914] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:13.127718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f43343-f9f3-4425-9665-75427e571e44 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:13.238662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f43343-f9f3-4425-9665-75427e571e44 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:13.273211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d46b97-feb3-42c0-b5b5-79da248bd499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:13.274347 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46b97-feb3-42c0-b5b5-79da248bd499 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:13.274795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46b97-feb3-42c0-b5b5-79da248bd499 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:13.275221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46b97-feb3-42c0-b5b5-79da248bd499 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:13.276016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d46b97-feb3-42c0-b5b5-79da248bd499 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:13.277551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d46b97-feb3-42c0-b5b5-79da248bd499 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:13.289368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-c3d46b97-feb3-42c0-b5b5-79da248bd499 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:40:13.291174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 454/915] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:40:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:13.297268 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe518ddd-27d5-4e0f-bd5e-000b365e32a2 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:13.388656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbe152-93ac-4f42-85d1-fda05f231771 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:13.389262 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbe152-93ac-4f42-85d1-fda05f231771 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:13.389733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbe152-93ac-4f42-85d1-fda05f231771 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:13.392114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 455/916] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:13.396881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe518ddd-27d5-4e0f-bd5e-000b365e32a2 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:13.397775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492d6a6-ed17-4798-b013-e53425b6a752 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:13.398305 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492d6a6-ed17-4798-b013-e53425b6a752 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:13.398774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492d6a6-ed17-4798-b013-e53425b6a752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:13.417244 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f492d6a6-ed17-4798-b013-e53425b6a752 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:13.418443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f492d6a6-ed17-4798-b013-e53425b6a752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:13.443142 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058d2e8-9db7-4b7a-b4fe-e2a2e6d2be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:13.444771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058d2e8-9db7-4b7a-b4fe-e2a2e6d2be8d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:13.445213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058d2e8-9db7-4b7a-b4fe-e2a2e6d2be8d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:13.445669 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058d2e8-9db7-4b7a-b4fe-e2a2e6d2be8d None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:13.446780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058d2e8-9db7-4b7a-b4fe-e2a2e6d2be8d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:13.447642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058d2e8-9db7-4b7a-b4fe-e2a2e6d2be8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:13.449764 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058d2e8-9db7-4b7a-b4fe-e2a2e6d2be8d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:13.457661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 462/917] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:40:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:13.465112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058d2e8-9db7-4b7a-b4fe-e2a2e6d2be8d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:13.498502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 456/918] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:13.517367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492d6a6-ed17-4798-b013-e53425b6a752 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:13.578966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058d2e8-9db7-4b7a-b4fe-e2a2e6d2be8d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:13.643758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eb01a-2eae-4936-8264-b1e72fc0b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:13.644769 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb01a-2eae-4936-8264-b1e72fc0b276 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:13.645292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb01a-2eae-4936-8264-b1e72fc0b276 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:13.645749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb01a-2eae-4936-8264-b1e72fc0b276 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:13.646687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eb01a-2eae-4936-8264-b1e72fc0b276 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:13.647191 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eb01a-2eae-4936-8264-b1e72fc0b276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:13.649359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eb01a-2eae-4936-8264-b1e72fc0b276 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:13.657480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492d6a6-ed17-4798-b013-e53425b6a752 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:13.662410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 463/919] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Oct 28 19:40:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:13.667542 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eb01a-2eae-4936-8264-b1e72fc0b276 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:13.712145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deda5a1-ed4f-45c1-93dc-4a0c6c11468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:13.713111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deda5a1-ed4f-45c1-93dc-4a0c6c11468c None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:13.713319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deda5a1-ed4f-45c1-93dc-4a0c6c11468c None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:13.713591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deda5a1-ed4f-45c1-93dc-4a0c6c11468c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:13.714342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deda5a1-ed4f-45c1-93dc-4a0c6c11468c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:13.715713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deda5a1-ed4f-45c1-93dc-4a0c6c11468c None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:13.737766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-4deda5a1-ed4f-45c1-93dc-4a0c6c11468c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:40:13.748021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 457/920] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:13.748933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deda5a1-ed4f-45c1-93dc-4a0c6c11468c None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:13.775499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eb01a-2eae-4936-8264-b1e72fc0b276 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:13.809983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d23908-f055-4ff0-995a-9956313e93c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:13.811070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d23908-f055-4ff0-995a-9956313e93c2 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:13.811554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d23908-f055-4ff0-995a-9956313e93c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:13.812009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d23908-f055-4ff0-995a-9956313e93c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:13.813045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d23908-f055-4ff0-995a-9956313e93c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:13.814637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d23908-f055-4ff0-995a-9956313e93c2 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:13.844709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 464/921] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:40:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:13.936500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deda5a1-ed4f-45c1-93dc-4a0c6c11468c None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:13.979495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6652a-256f-4a60-b456-148e11d12d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:13.980205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6652a-256f-4a60-b456-148e11d12d7c None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:13.980493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6652a-256f-4a60-b456-148e11d12d7c None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:13.980761 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6652a-256f-4a60-b456-148e11d12d7c None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:13.981519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6652a-256f-4a60-b456-148e11d12d7c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:13.981827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6652a-256f-4a60-b456-148e11d12d7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:13.983368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6652a-256f-4a60-b456-148e11d12d7c None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:13.989257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 458/922] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Oct 28 19:40:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:13.995693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d23908-f055-4ff0-995a-9956313e93c2 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:14.156003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d23908-f055-4ff0-995a-9956313e93c2 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:14.193491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34b4e8-a2db-4381-bb71-e9f6c0ab3d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:14.194561 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34b4e8-a2db-4381-bb71-e9f6c0ab3d5d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:14.195047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34b4e8-a2db-4381-bb71-e9f6c0ab3d5d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:14.195512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34b4e8-a2db-4381-bb71-e9f6c0ab3d5d None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:14.196413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34b4e8-a2db-4381-bb71-e9f6c0ab3d5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:14.196897 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34b4e8-a2db-4381-bb71-e9f6c0ab3d5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:14.198491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34b4e8-a2db-4381-bb71-e9f6c0ab3d5d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:14.204951 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 465/923] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Oct 28 19:40:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:14.210875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6652a-256f-4a60-b456-148e11d12d7c None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:14.326954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6652a-256f-4a60-b456-148e11d12d7c None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:14.363234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57127f29-70de-47ed-b92b-96b6b29d84d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:14.364360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57127f29-70de-47ed-b92b-96b6b29d84d4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:14.364846 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57127f29-70de-47ed-b92b-96b6b29d84d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:14.365299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57127f29-70de-47ed-b92b-96b6b29d84d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:14.366302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57127f29-70de-47ed-b92b-96b6b29d84d4 None admin] RBAC: Adding query filter params (interface=public, service_id=e93c2e91619145c5b6776082749057d8, region_id=RegionOne) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:14.366796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57127f29-70de-47ed-b92b-96b6b29d84d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:14.368346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57127f29-70de-47ed-b92b-96b6b29d84d4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:14.374373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 459/924] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Oct 28 19:40:14 2022] GET /identity/v3/endpoints?service_id=e93c2e91619145c5b6776082749057d8&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:14.381841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34b4e8-a2db-4381-bb71-e9f6c0ab3d5d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:14.481470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34b4e8-a2db-4381-bb71-e9f6c0ab3d5d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:14.514641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694a525-df02-4ee7-acfa-924f2958b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:14.515654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694a525-df02-4ee7-acfa-924f2958b299 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:14.516192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694a525-df02-4ee7-acfa-924f2958b299 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:14.516636 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694a525-df02-4ee7-acfa-924f2958b299 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:14.517490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694a525-df02-4ee7-acfa-924f2958b299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:14.519081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694a525-df02-4ee7-acfa-924f2958b299 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:14.525655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 466/925] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Oct 28 19:40:14 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:40:14.679965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1984-1d13-4d85-9d71-85c92cddac5c None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:14.681004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1984-1d13-4d85-9d71-85c92cddac5c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:14.681483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1984-1d13-4d85-9d71-85c92cddac5c None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:14.683901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 460/926] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:14.689673 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de1f6-6db3-4ae6-9f0a-46800c8ea885 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:14.690214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de1f6-6db3-4ae6-9f0a-46800c8ea885 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:14.690291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de1f6-6db3-4ae6-9f0a-46800c8ea885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:14.708235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4d4de1f6-6db3-4ae6-9f0a-46800c8ea885 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:14.709438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4d4de1f6-6db3-4ae6-9f0a-46800c8ea885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:14.782257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 467/927] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:14.801201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c1984-1d13-4d85-9d71-85c92cddac5c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:14.903625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c1984-1d13-4d85-9d71-85c92cddac5c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:14.938229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b9b22-7424-414d-a6ab-cb8207c3a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:14.939060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9b22-7424-414d-a6ab-cb8207c3a4cf None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:14.939342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9b22-7424-414d-a6ab-cb8207c3a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:14.939609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9b22-7424-414d-a6ab-cb8207c3a4cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:14.950125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b9b22-7424-414d-a6ab-cb8207c3a4cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:14.957698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-6d4b9b22-7424-414d-a6ab-cb8207c3a4cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:40:14.964015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 461/928] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Oct 28 19:40:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:14.965464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de1f6-6db3-4ae6-9f0a-46800c8ea885 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:15.061526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de1f6-6db3-4ae6-9f0a-46800c8ea885 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:15.094980 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dd02f-d255-4c0b-827f-5d9ad7d34072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:15.095682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dd02f-d255-4c0b-827f-5d9ad7d34072 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:15.095959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dd02f-d255-4c0b-827f-5d9ad7d34072 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:15.096227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dd02f-d255-4c0b-827f-5d9ad7d34072 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:15.097001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dd02f-d255-4c0b-827f-5d9ad7d34072 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:15.097302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dd02f-d255-4c0b-827f-5d9ad7d34072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:15.098911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dd02f-d255-4c0b-827f-5d9ad7d34072 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:15.109161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 468/929] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Oct 28 19:40:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:15.115728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b9b22-7424-414d-a6ab-cb8207c3a4cf None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:15.218765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b9b22-7424-414d-a6ab-cb8207c3a4cf None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:15.252711 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e3b39-083f-40e1-8b20-3050fa51a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:15.253529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e3b39-083f-40e1-8b20-3050fa51a07b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:15.253812 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e3b39-083f-40e1-8b20-3050fa51a07b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:15.254112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e3b39-083f-40e1-8b20-3050fa51a07b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:15.264833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e3b39-083f-40e1-8b20-3050fa51a07b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:15.266375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e3b39-083f-40e1-8b20-3050fa51a07b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:15.282840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-212e3b39-083f-40e1-8b20-3050fa51a07b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:15.284371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 462/930] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:15.290518 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dd02f-d255-4c0b-827f-5d9ad7d34072 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:15.389397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dd02f-d255-4c0b-827f-5d9ad7d34072 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:15.423676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bbfff-3647-4d30-a135-abb3fd3d5a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:15.424699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bbfff-3647-4d30-a135-abb3fd3d5a2f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:15.425223 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bbfff-3647-4d30-a135-abb3fd3d5a2f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:15.425713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bbfff-3647-4d30-a135-abb3fd3d5a2f None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:15.426682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bbfff-3647-4d30-a135-abb3fd3d5a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:15.427181 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bbfff-3647-4d30-a135-abb3fd3d5a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:15.428750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bbfff-3647-4d30-a135-abb3fd3d5a2f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:15.441183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 469/931] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:15.447080 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e3b39-083f-40e1-8b20-3050fa51a07b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:15.491312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca659b5-ae9a-482a-875c-0a785707a2cb None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:15.491639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca659b5-ae9a-482a-875c-0a785707a2cb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:15.491865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca659b5-ae9a-482a-875c-0a785707a2cb None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:15.493812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 470/932] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:15.498907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712da3-57f5-459b-a0cb-f1bb6941d481 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:15.499187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712da3-57f5-459b-a0cb-f1bb6941d481 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:15.499495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712da3-57f5-459b-a0cb-f1bb6941d481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:15.516346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0f712da3-57f5-459b-a0cb-f1bb6941d481 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:15.517852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0f712da3-57f5-459b-a0cb-f1bb6941d481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:15.561289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e3b39-083f-40e1-8b20-3050fa51a07b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:15.598228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 471/933] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:15.606177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81024-b634-4e4e-9a96-bffab710f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:15.607242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81024-b634-4e4e-9a96-bffab710f09e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:15.607735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81024-b634-4e4e-9a96-bffab710f09e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:15.608175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81024-b634-4e4e-9a96-bffab710f09e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:15.616704 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec81024-b634-4e4e-9a96-bffab710f09e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:15.618501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec81024-b634-4e4e-9a96-bffab710f09e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:15.619912 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712da3-57f5-459b-a0cb-f1bb6941d481 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:15.639588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-eec81024-b634-4e4e-9a96-bffab710f09e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:40:15.641470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 463/934] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Oct 28 19:40:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:15.647637 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81024-b634-4e4e-9a96-bffab710f09e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:15.728264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712da3-57f5-459b-a0cb-f1bb6941d481 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:15.752004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81024-b634-4e4e-9a96-bffab710f09e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:15.764244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c8678-0f69-4054-a8ca-bec5fa566a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:15.765122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c8678-0f69-4054-a8ca-bec5fa566a50 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:15.765399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c8678-0f69-4054-a8ca-bec5fa566a50 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:15.765662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c8678-0f69-4054-a8ca-bec5fa566a50 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:15.766658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c8678-0f69-4054-a8ca-bec5fa566a50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:15.768273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c8678-0f69-4054-a8ca-bec5fa566a50 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:15.780056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-f17c8678-0f69-4054-a8ca-bec5fa566a50 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:40:15.781987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 472/935] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Oct 28 19:40:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:15.787866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c8678-0f69-4054-a8ca-bec5fa566a50 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:15.791256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e864031-62d5-4710-8976-03c0a3c9a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:15.792809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e864031-62d5-4710-8976-03c0a3c9a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:15.793178 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e864031-62d5-4710-8976-03c0a3c9a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:15.793465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e864031-62d5-4710-8976-03c0a3c9a7a1 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:15.794392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e864031-62d5-4710-8976-03c0a3c9a7a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:15.794702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e864031-62d5-4710-8976-03c0a3c9a7a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:15.796830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e864031-62d5-4710-8976-03c0a3c9a7a1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:15.818783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 464/936] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Oct 28 19:40:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:15.824398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e864031-62d5-4710-8976-03c0a3c9a7a1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:15.890399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c8678-0f69-4054-a8ca-bec5fa566a50 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:15.924285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa04a9-87d7-4f3d-8983-131b08019587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:15.925084 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa04a9-87d7-4f3d-8983-131b08019587 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:15.925219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa04a9-87d7-4f3d-8983-131b08019587 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:15.925501 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa04a9-87d7-4f3d-8983-131b08019587 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:15.926285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa04a9-87d7-4f3d-8983-131b08019587 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:15.926534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa04a9-87d7-4f3d-8983-131b08019587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:15.927926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa04a9-87d7-4f3d-8983-131b08019587 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:15.931697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e864031-62d5-4710-8976-03c0a3c9a7a1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:15.937458 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 473/937] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:15.939870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa04a9-87d7-4f3d-8983-131b08019587 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:15.977752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a35bf0-328b-4257-bdc6-93bfbf006d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:15.978841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35bf0-328b-4257-bdc6-93bfbf006d4f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:15.979204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35bf0-328b-4257-bdc6-93bfbf006d4f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:15.979569 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35bf0-328b-4257-bdc6-93bfbf006d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:15.992916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a35bf0-328b-4257-bdc6-93bfbf006d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:15.994872 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a35bf0-328b-4257-bdc6-93bfbf006d4f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:16.017759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-d9a35bf0-328b-4257-bdc6-93bfbf006d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:16.019612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 465/938] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:16.025644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a35bf0-328b-4257-bdc6-93bfbf006d4f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:16.069483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa04a9-87d7-4f3d-8983-131b08019587 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:16.116041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1338435-0a87-4e1e-ba5d-f8b741e4b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:16.116880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1338435-0a87-4e1e-ba5d-f8b741e4b718 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.117412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1338435-0a87-4e1e-ba5d-f8b741e4b718 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.117782 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1338435-0a87-4e1e-ba5d-f8b741e4b718 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.118940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1338435-0a87-4e1e-ba5d-f8b741e4b718 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:16.119362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1338435-0a87-4e1e-ba5d-f8b741e4b718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:16.120858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1338435-0a87-4e1e-ba5d-f8b741e4b718 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:16.130117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 474/939] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:16.134110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1338435-0a87-4e1e-ba5d-f8b741e4b718 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:16.137636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a35bf0-328b-4257-bdc6-93bfbf006d4f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:16.172316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0a920-2028-445a-9528-f5b95956844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:16.172908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0a920-2028-445a-9528-f5b95956844a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.173216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0a920-2028-445a-9528-f5b95956844a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.173562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0a920-2028-445a-9528-f5b95956844a None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.174685 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0a920-2028-445a-9528-f5b95956844a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:16.174792 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0a920-2028-445a-9528-f5b95956844a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:16.176245 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0a920-2028-445a-9528-f5b95956844a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:16.188627 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 466/940] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:16.194041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0a920-2028-445a-9528-f5b95956844a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:16.248575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1338435-0a87-4e1e-ba5d-f8b741e4b718 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:16.283000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5a23c-a745-44c7-a028-755e6db02d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:16.283681 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a23c-a745-44c7-a028-755e6db02d90 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.283966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a23c-a745-44c7-a028-755e6db02d90 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.284238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a23c-a745-44c7-a028-755e6db02d90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.285045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5a23c-a745-44c7-a028-755e6db02d90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:16.286464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5a23c-a745-44c7-a028-755e6db02d90 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:16.295134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0a920-2028-445a-9528-f5b95956844a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:16.307913 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 475/941] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:40:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:40:16.342393 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b304fd-9fc0-41e3-826e-886951b375a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:16.343442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b304fd-9fc0-41e3-826e-886951b375a3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.343773 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b304fd-9fc0-41e3-826e-886951b375a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.344098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b304fd-9fc0-41e3-826e-886951b375a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.353093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b304fd-9fc0-41e3-826e-886951b375a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:16.354763 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b304fd-9fc0-41e3-826e-886951b375a3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:16.371877 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-66b304fd-9fc0-41e3-826e-886951b375a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:16.373618 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 467/942] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:16.380123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5a23c-a745-44c7-a028-755e6db02d90 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:16.417151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c31708-7bc8-45d0-b976-27d0764efcd4 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.417486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c31708-7bc8-45d0-b976-27d0764efcd4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.417708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c31708-7bc8-45d0-b976-27d0764efcd4 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.419870 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 468/943] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:16.425997 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28899-6401-4b9c-bd7d-3c8057cae417 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.426217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28899-6401-4b9c-bd7d-3c8057cae417 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.426498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28899-6401-4b9c-bd7d-3c8057cae417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.443913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-84f28899-6401-4b9c-bd7d-3c8057cae417 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:16.445120 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-84f28899-6401-4b9c-bd7d-3c8057cae417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:16.509690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5a23c-a745-44c7-a028-755e6db02d90 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:16.517155 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 469/944] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:16.540201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f28899-6401-4b9c-bd7d-3c8057cae417 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:16.544154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74735ffc-16b6-45e3-b948-b6e5230e152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:16.544831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735ffc-16b6-45e3-b948-b6e5230e152d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.545111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735ffc-16b6-45e3-b948-b6e5230e152d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.545389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735ffc-16b6-45e3-b948-b6e5230e152d None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.546658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735ffc-16b6-45e3-b948-b6e5230e152d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:16.546964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735ffc-16b6-45e3-b948-b6e5230e152d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:16.548414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735ffc-16b6-45e3-b948-b6e5230e152d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:16.562672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 476/945] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:16.570334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74735ffc-16b6-45e3-b948-b6e5230e152d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:16.668453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f28899-6401-4b9c-bd7d-3c8057cae417 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:16.689524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74735ffc-16b6-45e3-b948-b6e5230e152d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:16.703581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:16.704508 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.704962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.705660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.706561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:16.708163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:16.709720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.common [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 19:40:16.729820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.sql.core [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 19:40:16.729820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:40:16.729820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [parameters: {'id': '27c7391723bb40efbb87abab4d5f328b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 19:40:16.729820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91691) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:40:16.732686 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d15b8-721a-42d3-99d6-69080e86fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:16.733631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d15b8-721a-42d3-99d6-69080e86fc54 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.733909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d15b8-721a-42d3-99d6-69080e86fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.734262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d15b8-721a-42d3-99d6-69080e86fc54 None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/c7fc75fab2e247ceaf897723c15023f9/roles/5d9f5b21f518437b9d6a33ac52315fb6` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.736683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d15b8-721a-42d3-99d6-69080e86fc54 None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=c7fc75fab2e247ceaf897723c15023f9, role_id=5d9f5b21f518437b9d6a33ac52315fb6)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:16.738157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d15b8-721a-42d3-99d6-69080e86fc54 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:16.739066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27c7391723bb40efbb87abab4d5f328b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27c7391723bb40efbb87abab4d5f328b. Oct 28 19:40:16.745672 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 470/946] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Oct 28 19:40:16 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:16.747088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:16.764859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 477/947] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:40:16 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/c7fc75fab2e247ceaf897723c15023f9/roles/5d9f5b21f518437b9d6a33ac52315fb6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:40:16.866010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3434f-3362-4fc4-a841-0f171a81c6a3 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:16.902212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef481ad-aa36-41ee-a859-11d379cf94df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:16.903085 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef481ad-aa36-41ee-a859-11d379cf94df None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.903377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef481ad-aa36-41ee-a859-11d379cf94df None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.903640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef481ad-aa36-41ee-a859-11d379cf94df None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.917543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef481ad-aa36-41ee-a859-11d379cf94df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:16.917543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef481ad-aa36-41ee-a859-11d379cf94df None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:16.933252 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-3ef481ad-aa36-41ee-a859-11d379cf94df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:16.935334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 471/948] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:16.941684 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d15b8-721a-42d3-99d6-69080e86fc54 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:16.979632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4385ee-61c9-4fb4-bb11-b9c3d29b3fe3 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.980496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4385ee-61c9-4fb4-bb11-b9c3d29b3fe3 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.980956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4385ee-61c9-4fb4-bb11-b9c3d29b3fe3 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:16.987425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 472/949] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:16.993142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f44d0-77dc-4f3e-adf5-08857f3ecfa2 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:16.993712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f44d0-77dc-4f3e-adf5-08857f3ecfa2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:16.994508 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f44d0-77dc-4f3e-adf5-08857f3ecfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:17.021454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-158f44d0-77dc-4f3e-adf5-08857f3ecfa2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:17.023005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-158f44d0-77dc-4f3e-adf5-08857f3ecfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:17.066862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d15b8-721a-42d3-99d6-69080e86fc54 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:17.096691 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 473/950] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:17.103226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ddd24-6177-43d0-84e5-6553c21cc427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:17.103955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ddd24-6177-43d0-84e5-6553c21cc427 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:17.104235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ddd24-6177-43d0-84e5-6553c21cc427 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:17.104509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ddd24-6177-43d0-84e5-6553c21cc427 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:17.105328 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ddd24-6177-43d0-84e5-6553c21cc427 None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:17.105627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ddd24-6177-43d0-84e5-6553c21cc427 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:17.107227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ddd24-6177-43d0-84e5-6553c21cc427 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:17.119130 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f44d0-77dc-4f3e-adf5-08857f3ecfa2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:17.125555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 478/951] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:40:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:17.226387 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f44d0-77dc-4f3e-adf5-08857f3ecfa2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:17.262239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bde5c6-47d1-4b3e-a577-6bea20a5471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:17.263083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bde5c6-47d1-4b3e-a577-6bea20a5471c None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:17.263364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bde5c6-47d1-4b3e-a577-6bea20a5471c None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:17.263633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bde5c6-47d1-4b3e-a577-6bea20a5471c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:17.264299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bde5c6-47d1-4b3e-a577-6bea20a5471c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:17.265793 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bde5c6-47d1-4b3e-a577-6bea20a5471c None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:17.277868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-41bde5c6-47d1-4b3e-a577-6bea20a5471c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:40:17.279573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 474/952] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:17.285707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ddd24-6177-43d0-84e5-6553c21cc427 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:17.392573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ddd24-6177-43d0-84e5-6553c21cc427 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:17.427495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5c52-bdb3-4d00-8de1-0c4660d7d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:17.428166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5c52-bdb3-4d00-8de1-0c4660d7d132 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:17.428441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5c52-bdb3-4d00-8de1-0c4660d7d132 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:17.428708 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5c52-bdb3-4d00-8de1-0c4660d7d132 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:17.429410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5c52-bdb3-4d00-8de1-0c4660d7d132 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:17.429707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5c52-bdb3-4d00-8de1-0c4660d7d132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:17.431116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5c52-bdb3-4d00-8de1-0c4660d7d132 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:17.436003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 479/953] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Oct 28 19:40:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:17.441700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bde5c6-47d1-4b3e-a577-6bea20a5471c None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:17.542622 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bde5c6-47d1-4b3e-a577-6bea20a5471c None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:17.583183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dfdba-64c5-4f13-ba48-fc1ea3daf848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:17.583863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dfdba-64c5-4f13-ba48-fc1ea3daf848 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:17.584177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dfdba-64c5-4f13-ba48-fc1ea3daf848 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:17.584461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dfdba-64c5-4f13-ba48-fc1ea3daf848 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:17.585183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dfdba-64c5-4f13-ba48-fc1ea3daf848 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:17.585532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dfdba-64c5-4f13-ba48-fc1ea3daf848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:17.586945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dfdba-64c5-4f13-ba48-fc1ea3daf848 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:17.592516 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 475/954] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Oct 28 19:40:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:17.598257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5c52-bdb3-4d00-8de1-0c4660d7d132 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:17.710033 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5c52-bdb3-4d00-8de1-0c4660d7d132 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:17.744576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dac3e-413c-4d22-b1a1-f58a22441cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:17.745322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dac3e-413c-4d22-b1a1-f58a22441cdd None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:17.745510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dac3e-413c-4d22-b1a1-f58a22441cdd None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:17.745781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dac3e-413c-4d22-b1a1-f58a22441cdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:17.746559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dac3e-413c-4d22-b1a1-f58a22441cdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:17.747922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dac3e-413c-4d22-b1a1-f58a22441cdd None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:17.768799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 480/955] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:40:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:18.758281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722a1c6-6d45-4a94-a520-283129acc781 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:18.758832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722a1c6-6d45-4a94-a520-283129acc781 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:18.758832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722a1c6-6d45-4a94-a520-283129acc781 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:18.760846 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 476/956] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:18.766444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059199-71fe-476c-979b-f226ab7550fa None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:18.766867 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059199-71fe-476c-979b-f226ab7550fa None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:18.767061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059199-71fe-476c-979b-f226ab7550fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:18.784332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-40059199-71fe-476c-979b-f226ab7550fa None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:18.785509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-40059199-71fe-476c-979b-f226ab7550fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:18.862278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 481/957] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:18.884548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722a1c6-6d45-4a94-a520-283129acc781 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:18.987908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722a1c6-6d45-4a94-a520-283129acc781 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:19.021158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c194a-8ed4-46e8-9154-11291a19924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:19.021970 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c194a-8ed4-46e8-9154-11291a19924d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.022357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c194a-8ed4-46e8-9154-11291a19924d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.022630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c194a-8ed4-46e8-9154-11291a19924d None admin] PATH_INFO: `/v3/services/compute` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.023289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c194a-8ed4-46e8-9154-11291a19924d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:19.024660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c194a-8ed4-46e8-9154-11291a19924d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:19.036223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-b32c194a-8ed4-46e8-9154-11291a19924d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:40:19.042208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 477/958] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:19.043987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059199-71fe-476c-979b-f226ab7550fa None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:19.139375 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059199-71fe-476c-979b-f226ab7550fa None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:19.175584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293277-7733-4262-8b88-5622ea093f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:19.176276 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293277-7733-4262-8b88-5622ea093f0c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.176552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293277-7733-4262-8b88-5622ea093f0c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.176892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293277-7733-4262-8b88-5622ea093f0c None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.177637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293277-7733-4262-8b88-5622ea093f0c None admin] RBAC: Adding query filter params (name=compute) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:19.177937 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293277-7733-4262-8b88-5622ea093f0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:19.179401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293277-7733-4262-8b88-5622ea093f0c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:19.185620 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 482/959] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:40:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:19.191773 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c194a-8ed4-46e8-9154-11291a19924d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:19.239726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e5069-59fd-4fcf-9458-ff3cd96d613f None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.240146 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e5069-59fd-4fcf-9458-ff3cd96d613f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.240512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e5069-59fd-4fcf-9458-ff3cd96d613f None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.242773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 483/960] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:19.247739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294c82e-4be1-4483-bf35-8a1e9939bc7c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.248141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294c82e-4be1-4483-bf35-8a1e9939bc7c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.248505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294c82e-4be1-4483-bf35-8a1e9939bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.265499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-3294c82e-4be1-4483-bf35-8a1e9939bc7c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:19.266834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3294c82e-4be1-4483-bf35-8a1e9939bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:19.293521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c194a-8ed4-46e8-9154-11291a19924d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:19.327437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838ebba-bdfb-4de8-aa07-4341078b4bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:19.328118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838ebba-bdfb-4de8-aa07-4341078b4bc2 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.328430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838ebba-bdfb-4de8-aa07-4341078b4bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.328709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838ebba-bdfb-4de8-aa07-4341078b4bc2 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.329413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838ebba-bdfb-4de8-aa07-4341078b4bc2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:19.329710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838ebba-bdfb-4de8-aa07-4341078b4bc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:19.331141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838ebba-bdfb-4de8-aa07-4341078b4bc2 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:19.338376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 484/962] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:19.342225 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 478/962] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:40:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:19.357422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294c82e-4be1-4483-bf35-8a1e9939bc7c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:19.464456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294c82e-4be1-4483-bf35-8a1e9939bc7c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:19.501292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dda34f-e708-4741-8556-6f57c97b4d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:19.502053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dda34f-e708-4741-8556-6f57c97b4d7d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.502357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dda34f-e708-4741-8556-6f57c97b4d7d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.502624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dda34f-e708-4741-8556-6f57c97b4d7d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.514753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dda34f-e708-4741-8556-6f57c97b4d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:19.522347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c1dda34f-e708-4741-8556-6f57c97b4d7d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:40:19.523971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 485/963] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Oct 28 19:40:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:19.530067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838ebba-bdfb-4de8-aa07-4341078b4bc2 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:19.555736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe204c53-d954-4c22-93b2-3c36501b112e None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.556086 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe204c53-d954-4c22-93b2-3c36501b112e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.556349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe204c53-d954-4c22-93b2-3c36501b112e None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.558422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 486/964] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:19.563745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af4849-0074-499f-bf4a-b1e5f8f4f7d8 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.564735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af4849-0074-499f-bf4a-b1e5f8f4f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.564735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af4849-0074-499f-bf4a-b1e5f8f4f7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.582202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d9af4849-0074-499f-bf4a-b1e5f8f4f7d8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:19.583497 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d9af4849-0074-499f-bf4a-b1e5f8f4f7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:19.654634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838ebba-bdfb-4de8-aa07-4341078b4bc2 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:19.667288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 487/965] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:19.692042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af4849-0074-499f-bf4a-b1e5f8f4f7d8 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:19.700886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898163ef-28bf-4701-a9c2-9366b00d9d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:19.701873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898163ef-28bf-4701-a9c2-9366b00d9d70 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.702725 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898163ef-28bf-4701-a9c2-9366b00d9d70 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.703208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898163ef-28bf-4701-a9c2-9366b00d9d70 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.704617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898163ef-28bf-4701-a9c2-9366b00d9d70 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:19.705200 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898163ef-28bf-4701-a9c2-9366b00d9d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:19.707045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898163ef-28bf-4701-a9c2-9366b00d9d70 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:19.719443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 479/966] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Oct 28 19:40:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:19.725445 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898163ef-28bf-4701-a9c2-9366b00d9d70 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:19.798504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af4849-0074-499f-bf4a-b1e5f8f4f7d8 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:19.834722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:19.835359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.835645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.835921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.836639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:19.838118 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:19.839035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898163ef-28bf-4701-a9c2-9366b00d9d70 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:19.839472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.common [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 19:40:19.852719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.sql.core [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 19:40:19.852719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 19:40:19.852719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [parameters: {'user_id': '6ed5bd12b8494d41b1b96deea0c87bca', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 19:40:19.852719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91690) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:40:19.867855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 19:40:19.874471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 488/967] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Oct 28 19:40:19 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:19.875626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d871327-0e87-48ea-8c12-95744f48fa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:19.875751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:19.876823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d871327-0e87-48ea-8c12-95744f48fa39 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:19.877361 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d871327-0e87-48ea-8c12-95744f48fa39 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:19.877867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d871327-0e87-48ea-8c12-95744f48fa39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:19.889940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d871327-0e87-48ea-8c12-95744f48fa39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:19.891674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d871327-0e87-48ea-8c12-95744f48fa39 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:19.908192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-6d871327-0e87-48ea-8c12-95744f48fa39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:19.914598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 480/968] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:19.916242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d871327-0e87-48ea-8c12-95744f48fa39 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:19.977889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b864a-5763-49c9-b88f-6d4d86d74cc9 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.011528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d520c7-479d-428c-a275-d5b09ecee758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.012488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d520c7-479d-428c-a275-d5b09ecee758 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.012662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d520c7-479d-428c-a275-d5b09ecee758 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.012942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d520c7-479d-428c-a275-d5b09ecee758 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.018895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d871327-0e87-48ea-8c12-95744f48fa39 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.021913 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d520c7-479d-428c-a275-d5b09ecee758 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.022900 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d520c7-479d-428c-a275-d5b09ecee758 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.037045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-79d520c7-479d-428c-a275-d5b09ecee758 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:40:20.043426 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 489/969] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:40:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:20.044282 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d520c7-479d-428c-a275-d5b09ecee758 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:20.055012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00a5a1-ac15-48be-8cdc-f42cd1910992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.056052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a5a1-ac15-48be-8cdc-f42cd1910992 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.056532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a5a1-ac15-48be-8cdc-f42cd1910992 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.056989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a5a1-ac15-48be-8cdc-f42cd1910992 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.057907 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00a5a1-ac15-48be-8cdc-f42cd1910992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:20.058423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00a5a1-ac15-48be-8cdc-f42cd1910992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.060054 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00a5a1-ac15-48be-8cdc-f42cd1910992 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.077341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 481/970] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:20.078571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00a5a1-ac15-48be-8cdc-f42cd1910992 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:20.144844 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d520c7-479d-428c-a275-d5b09ecee758 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.177128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00a5a1-ac15-48be-8cdc-f42cd1910992 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.179378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7731c8-5c4d-408b-9b98-a14bc2ced50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.180075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7731c8-5c4d-408b-9b98-a14bc2ced50e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.180354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7731c8-5c4d-408b-9b98-a14bc2ced50e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.180618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7731c8-5c4d-408b-9b98-a14bc2ced50e None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.181420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7731c8-5c4d-408b-9b98-a14bc2ced50e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:20.184593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7731c8-5c4d-408b-9b98-a14bc2ced50e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.184593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7731c8-5c4d-408b-9b98-a14bc2ced50e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.214005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97abbd-5d4a-4466-b65b-16ffc537ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.214876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97abbd-5d4a-4466-b65b-16ffc537ec7a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.215226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97abbd-5d4a-4466-b65b-16ffc537ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.215496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97abbd-5d4a-4466-b65b-16ffc537ec7a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.222507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 490/971] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Oct 28 19:40:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:20.223876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9a103-82bc-4089-8df7-e284a2dcc2b0 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.224135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9a103-82bc-4089-8df7-e284a2dcc2b0 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.224431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9a103-82bc-4089-8df7-e284a2dcc2b0 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.230875 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 491/972] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:20.231061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97abbd-5d4a-4466-b65b-16ffc537ec7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.231061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97abbd-5d4a-4466-b65b-16ffc537ec7a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.232204 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1db2f-018d-4a59-b4cb-e0c2d3a2975d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.232489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1db2f-018d-4a59-b4cb-e0c2d3a2975d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.232755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1db2f-018d-4a59-b4cb-e0c2d3a2975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.250853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-2f97abbd-5d4a-4466-b65b-16ffc537ec7a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:40:20.251257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ffc1db2f-018d-4a59-b4cb-e0c2d3a2975d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:20.252869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ffc1db2f-018d-4a59-b4cb-e0c2d3a2975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:20.253316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 482/973] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Oct 28 19:40:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:20.258668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97abbd-5d4a-4466-b65b-16ffc537ec7a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:20.338892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 492/974] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:20.362493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1db2f-018d-4a59-b4cb-e0c2d3a2975d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:20.403100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97abbd-5d4a-4466-b65b-16ffc537ec7a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.443925 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e5aba-84fd-445d-970f-3a9893861df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.445462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e5aba-84fd-445d-970f-3a9893861df1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.445748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e5aba-84fd-445d-970f-3a9893861df1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.446027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e5aba-84fd-445d-970f-3a9893861df1 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.446915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e5aba-84fd-445d-970f-3a9893861df1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:20.447224 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e5aba-84fd-445d-970f-3a9893861df1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.448685 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e5aba-84fd-445d-970f-3a9893861df1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.468874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 483/975] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Oct 28 19:40:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:20.474584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e5aba-84fd-445d-970f-3a9893861df1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:20.474870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1db2f-018d-4a59-b4cb-e0c2d3a2975d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.516790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c9c5e-6c27-4338-9095-93d0f705a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.517634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c9c5e-6c27-4338-9095-93d0f705a028 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.518116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c9c5e-6c27-4338-9095-93d0f705a028 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.518719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c9c5e-6c27-4338-9095-93d0f705a028 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.518989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c9c5e-6c27-4338-9095-93d0f705a028 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.520395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c9c5e-6c27-4338-9095-93d0f705a028 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.533574 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-d10c9c5e-6c27-4338-9095-93d0f705a028 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:40:20.535152 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 493/976] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:20.540996 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c9c5e-6c27-4338-9095-93d0f705a028 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:20.601138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e5aba-84fd-445d-970f-3a9893861df1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.634691 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece01c-5068-4243-99bd-7609dd57c18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.635342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece01c-5068-4243-99bd-7609dd57c18a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.635617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece01c-5068-4243-99bd-7609dd57c18a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.635887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece01c-5068-4243-99bd-7609dd57c18a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.640964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c9c5e-6c27-4338-9095-93d0f705a028 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.674552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17852924-7be9-4bb8-8e41-1871deeea66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.675328 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17852924-7be9-4bb8-8e41-1871deeea66e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.675584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17852924-7be9-4bb8-8e41-1871deeea66e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.675858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17852924-7be9-4bb8-8e41-1871deeea66e None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.676576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17852924-7be9-4bb8-8e41-1871deeea66e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:20.676922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17852924-7be9-4bb8-8e41-1871deeea66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.678334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17852924-7be9-4bb8-8e41-1871deeea66e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.683132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 494/977] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Oct 28 19:40:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:20.688717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17852924-7be9-4bb8-8e41-1871deeea66e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:20.716324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ece01c-5068-4243-99bd-7609dd57c18a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.718055 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ece01c-5068-4243-99bd-7609dd57c18a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.788140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17852924-7be9-4bb8-8e41-1871deeea66e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.812498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 484/978] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:20 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:20.818198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece01c-5068-4243-99bd-7609dd57c18a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:20.821642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863e6d8-ca42-4f85-8e90-bc8886eb7231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.822343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e6d8-ca42-4f85-8e90-bc8886eb7231 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.822621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e6d8-ca42-4f85-8e90-bc8886eb7231 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.822892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e6d8-ca42-4f85-8e90-bc8886eb7231 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.823602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863e6d8-ca42-4f85-8e90-bc8886eb7231 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:20.823905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863e6d8-ca42-4f85-8e90-bc8886eb7231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.825273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863e6d8-ca42-4f85-8e90-bc8886eb7231 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.830108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 495/979] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Oct 28 19:40:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:20.835811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863e6d8-ca42-4f85-8e90-bc8886eb7231 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:20.925916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece01c-5068-4243-99bd-7609dd57c18a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.934708 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863e6d8-ca42-4f85-8e90-bc8886eb7231 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:20.959283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e7476-c077-41db-a6e8-7e5321f28d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.960417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e7476-c077-41db-a6e8-7e5321f28d2f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.960706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e7476-c077-41db-a6e8-7e5321f28d2f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.960984 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e7476-c077-41db-a6e8-7e5321f28d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.968270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b5d73-4a8a-46e5-95d8-5536b3359457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:20.968945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5d73-4a8a-46e5-95d8-5536b3359457 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:20.969406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5d73-4a8a-46e5-95d8-5536b3359457 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:20.969512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5d73-4a8a-46e5-95d8-5536b3359457 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:20.970295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b5d73-4a8a-46e5-95d8-5536b3359457 None admin] RBAC: Adding query filter params (interface=admin, service_id=e93c2e91619145c5b6776082749057d8, region_id=RegionOne) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:20.970601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b5d73-4a8a-46e5-95d8-5536b3359457 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.971268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e7476-c077-41db-a6e8-7e5321f28d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:20.971987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b5d73-4a8a-46e5-95d8-5536b3359457 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.972749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e7476-c077-41db-a6e8-7e5321f28d2f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:20.981917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 496/980] 10.222.0.20 () {56 vars in 1249 bytes} [Fri Oct 28 19:40:20 2022] GET /identity/v3/endpoints?service_id=e93c2e91619145c5b6776082749057d8&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:20.984759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b5d73-4a8a-46e5-95d8-5536b3359457 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:20.993815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-c89e7476-c077-41db-a6e8-7e5321f28d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:20.996079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 485/981] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:21.001402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e7476-c077-41db-a6e8-7e5321f28d2f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:21.083192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b5d73-4a8a-46e5-95d8-5536b3359457 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:21.098014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e7476-c077-41db-a6e8-7e5321f28d2f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:21.116110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf26a7-63b7-4f62-a627-711e0510733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:21.117121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf26a7-63b7-4f62-a627-711e0510733b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:21.117598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf26a7-63b7-4f62-a627-711e0510733b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:21.118042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf26a7-63b7-4f62-a627-711e0510733b None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:21.118941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf26a7-63b7-4f62-a627-711e0510733b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:21.120522 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf26a7-63b7-4f62-a627-711e0510733b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:21.126545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 497/982] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Oct 28 19:40:20 2022] GET /identity/v3/services => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:40:21.133263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3fb8-e115-4f67-93b9-c36ca4cbc1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:21.134353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3fb8-e115-4f67-93b9-c36ca4cbc1b8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:21.134838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3fb8-e115-4f67-93b9-c36ca4cbc1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:21.135302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3fb8-e115-4f67-93b9-c36ca4cbc1b8 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:21.136273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c3fb8-e115-4f67-93b9-c36ca4cbc1b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:21.136783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c3fb8-e115-4f67-93b9-c36ca4cbc1b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:21.138436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c3fb8-e115-4f67-93b9-c36ca4cbc1b8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:21.156496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 486/983] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:21.157765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf26a7-63b7-4f62-a627-711e0510733b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:21.264129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf26a7-63b7-4f62-a627-711e0510733b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:21.302055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeecfb-09fb-4194-9aff-e24e75587e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:21.302909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeecfb-09fb-4194-9aff-e24e75587e4c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:21.303184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeecfb-09fb-4194-9aff-e24e75587e4c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:21.303440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeecfb-09fb-4194-9aff-e24e75587e4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:21.310988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeecfb-09fb-4194-9aff-e24e75587e4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:21.312519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeecfb-09fb-4194-9aff-e24e75587e4c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:21.328592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-a2eeecfb-09fb-4194-9aff-e24e75587e4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:21.329796 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 498/984] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:21.335668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3fb8-e115-4f67-93b9-c36ca4cbc1b8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:21.438020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3fb8-e115-4f67-93b9-c36ca4cbc1b8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:21.471653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fdcff-7cbc-4964-bddc-2ed453c53ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:21.472321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fdcff-7cbc-4964-bddc-2ed453c53ce8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:21.472599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fdcff-7cbc-4964-bddc-2ed453c53ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:21.472878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fdcff-7cbc-4964-bddc-2ed453c53ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:21.473663 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fdcff-7cbc-4964-bddc-2ed453c53ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:21.474130 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fdcff-7cbc-4964-bddc-2ed453c53ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:21.475550 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fdcff-7cbc-4964-bddc-2ed453c53ce8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:21.487823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 487/985] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:21.493738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeecfb-09fb-4194-9aff-e24e75587e4c None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:21.590523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeecfb-09fb-4194-9aff-e24e75587e4c None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:21.623244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef3184-3694-478e-8375-793e010bc908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:21.623929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3184-3694-478e-8375-793e010bc908 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:21.624212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3184-3694-478e-8375-793e010bc908 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:21.624488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3184-3694-478e-8375-793e010bc908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:21.625316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3184-3694-478e-8375-793e010bc908 None admin] RBAC: Adding query filter params (role.id=5d9f5b21f518437b9d6a33ac52315fb6, scope.project.id=e91226b635934bfcb949577491791af4, user.id=c7fc75fab2e247ceaf897723c15023f9) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:21.625626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3184-3694-478e-8375-793e010bc908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:21.627139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3184-3694-478e-8375-793e010bc908 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:21.633048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 499/986] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:21 2022] GET /identity/v3/role_assignments?user.id=c7fc75fab2e247ceaf897723c15023f9&scope.project.id=e91226b635934bfcb949577491791af4&role.id=5d9f5b21f518437b9d6a33ac52315fb6 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:21.715978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488159ee-a109-4d20-864d-3c9750e35377 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:21.716311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488159ee-a109-4d20-864d-3c9750e35377 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:21.716583 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488159ee-a109-4d20-864d-3c9750e35377 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:21.719095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 488/987] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:21.725397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c813f-4866-43b3-b0fe-7c56370a6c45 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:21.725689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c813f-4866-43b3-b0fe-7c56370a6c45 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:21.725965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c813f-4866-43b3-b0fe-7c56370a6c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:21.743649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-a62c813f-4866-43b3-b0fe-7c56370a6c45 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:21.744869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-a62c813f-4866-43b3-b0fe-7c56370a6c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:21.819116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 500/988] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:21.842563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488159ee-a109-4d20-864d-3c9750e35377 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:21.942471 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488159ee-a109-4d20-864d-3c9750e35377 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:21.977208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53d04-3dd3-4f8b-aa7f-57c6c5378f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:21.977915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53d04-3dd3-4f8b-aa7f-57c6c5378f1a None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:21.978243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53d04-3dd3-4f8b-aa7f-57c6c5378f1a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:21.978512 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53d04-3dd3-4f8b-aa7f-57c6c5378f1a None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:21.979249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53d04-3dd3-4f8b-aa7f-57c6c5378f1a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:21.980677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53d04-3dd3-4f8b-aa7f-57c6c5378f1a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:21.994617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 489/989] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:40:21 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:23.463247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c198-4020-4e21-9305-0aabb50e3ec2 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:23.463799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c198-4020-4e21-9305-0aabb50e3ec2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:23.463799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653c198-4020-4e21-9305-0aabb50e3ec2 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:23.465515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 501/990] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:23.471373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e680f5e-ca82-4bc8-9ae1-c85c08c2f66d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:23.471788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e680f5e-ca82-4bc8-9ae1-c85c08c2f66d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:23.472018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e680f5e-ca82-4bc8-9ae1-c85c08c2f66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:23.489198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-2e680f5e-ca82-4bc8-9ae1-c85c08c2f66d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:23.490402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2e680f5e-ca82-4bc8-9ae1-c85c08c2f66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:23.564154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 490/991] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:23.586694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653c198-4020-4e21-9305-0aabb50e3ec2 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:23.691487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653c198-4020-4e21-9305-0aabb50e3ec2 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:23.725795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7910622-3874-4a62-8b98-a7b8622a47f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:23.726577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7910622-3874-4a62-8b98-a7b8622a47f6 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:23.726856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7910622-3874-4a62-8b98-a7b8622a47f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:23.727127 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7910622-3874-4a62-8b98-a7b8622a47f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:23.727789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7910622-3874-4a62-8b98-a7b8622a47f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:23.729173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7910622-3874-4a62-8b98-a7b8622a47f6 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:23.740292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-a7910622-3874-4a62-8b98-a7b8622a47f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:40:23.741737 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 502/992] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Oct 28 19:40:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:23.747615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e680f5e-ca82-4bc8-9ae1-c85c08c2f66d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:23.844864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e680f5e-ca82-4bc8-9ae1-c85c08c2f66d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:23.877842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a696b1-01a7-48ae-b6db-7c590a0a6227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:23.878901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a696b1-01a7-48ae-b6db-7c590a0a6227 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:23.879387 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a696b1-01a7-48ae-b6db-7c590a0a6227 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:23.879849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a696b1-01a7-48ae-b6db-7c590a0a6227 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:23.880735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a696b1-01a7-48ae-b6db-7c590a0a6227 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:23.881223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a696b1-01a7-48ae-b6db-7c590a0a6227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:23.882804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a696b1-01a7-48ae-b6db-7c590a0a6227 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:23.892298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 491/993] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Oct 28 19:40:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:23.893879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7910622-3874-4a62-8b98-a7b8622a47f6 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:23.966125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32f066-de7c-4330-992a-1b9b49b6558c None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:23.966482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32f066-de7c-4330-992a-1b9b49b6558c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:23.966642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32f066-de7c-4330-992a-1b9b49b6558c None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:23.968778 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 492/994] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:23.974513 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458aa2-a93e-4df5-9999-24a93ae2f73b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:23.974808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458aa2-a93e-4df5-9999-24a93ae2f73b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:23.975065 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458aa2-a93e-4df5-9999-24a93ae2f73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:23.992861 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-bf458aa2-a93e-4df5-9999-24a93ae2f73b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:23.994043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bf458aa2-a93e-4df5-9999-24a93ae2f73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:23.999189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7910622-3874-4a62-8b98-a7b8622a47f6 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:24.031921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fda1d-654c-4e8e-b169-048f859dad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:24.032601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fda1d-654c-4e8e-b169-048f859dad42 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:24.032883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fda1d-654c-4e8e-b169-048f859dad42 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:24.033157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fda1d-654c-4e8e-b169-048f859dad42 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:24.033862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fda1d-654c-4e8e-b169-048f859dad42 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:24.034203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fda1d-654c-4e8e-b169-048f859dad42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:24.035581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fda1d-654c-4e8e-b169-048f859dad42 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:24.040520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 503/995] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Oct 28 19:40:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:24.046327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fda1d-654c-4e8e-b169-048f859dad42 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:24.059903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 493/996] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:24.082451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf458aa2-a93e-4df5-9999-24a93ae2f73b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:24.141044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fda1d-654c-4e8e-b169-048f859dad42 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:24.173085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b90f-fb1f-4aed-b005-fe19220b833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:24.173740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b90f-fb1f-4aed-b005-fe19220b833f None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:24.174019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b90f-fb1f-4aed-b005-fe19220b833f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:24.174328 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b90f-fb1f-4aed-b005-fe19220b833f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:24.175056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b90f-fb1f-4aed-b005-fe19220b833f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:24.176344 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf458aa2-a93e-4df5-9999-24a93ae2f73b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:24.176511 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b90f-fb1f-4aed-b005-fe19220b833f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:24.193373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 504/997] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:40:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:24.217437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d53d28-06ac-4f0e-8fa5-c2107392b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:24.218289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53d28-06ac-4f0e-8fa5-c2107392b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:24.218568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53d28-06ac-4f0e-8fa5-c2107392b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:24.218838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53d28-06ac-4f0e-8fa5-c2107392b5e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:24.219510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d53d28-06ac-4f0e-8fa5-c2107392b5e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:24.221013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d53d28-06ac-4f0e-8fa5-c2107392b5e4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:24.232992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-01d53d28-06ac-4f0e-8fa5-c2107392b5e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:40:24.234509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 494/998] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Oct 28 19:40:24 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:24.240840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b90f-fb1f-4aed-b005-fe19220b833f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:24.328574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3128449-2188-4085-b4d7-55268cdb4deb None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:24.328756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3128449-2188-4085-b4d7-55268cdb4deb None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:24.329020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3128449-2188-4085-b4d7-55268cdb4deb None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:24.330912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 495/999] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:24.336777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f17899-286f-472a-93ae-fb8bc75c81fc None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:24.337016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f17899-286f-472a-93ae-fb8bc75c81fc None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:24.337319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f17899-286f-472a-93ae-fb8bc75c81fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:24.353064 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b90f-fb1f-4aed-b005-fe19220b833f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:24.355815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-66f17899-286f-472a-93ae-fb8bc75c81fc None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:24.357024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-66f17899-286f-472a-93ae-fb8bc75c81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:24.389941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac31d2-e2ac-46e6-b314-9a8d0383306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:24.390895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac31d2-e2ac-46e6-b314-9a8d0383306d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:24.391305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac31d2-e2ac-46e6-b314-9a8d0383306d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:24.391723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac31d2-e2ac-46e6-b314-9a8d0383306d None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:24.392848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac31d2-e2ac-46e6-b314-9a8d0383306d None admin] RBAC: Adding query filter params (name=image) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:24.392848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac31d2-e2ac-46e6-b314-9a8d0383306d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:24.394121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac31d2-e2ac-46e6-b314-9a8d0383306d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:24.402236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 505/1000] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:24.405386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac31d2-e2ac-46e6-b314-9a8d0383306d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:24.425115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 496/1001] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:24.449765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f17899-286f-472a-93ae-fb8bc75c81fc None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:24.502364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac31d2-e2ac-46e6-b314-9a8d0383306d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:24.534757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750bb8-f544-4ccc-bd55-ec47ad889c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:24.535427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750bb8-f544-4ccc-bd55-ec47ad889c01 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:24.535719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750bb8-f544-4ccc-bd55-ec47ad889c01 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:24.535993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750bb8-f544-4ccc-bd55-ec47ad889c01 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:24.536699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25750bb8-f544-4ccc-bd55-ec47ad889c01 None admin] RBAC: Adding query filter params (type=image) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:24.537003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25750bb8-f544-4ccc-bd55-ec47ad889c01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:24.538401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25750bb8-f544-4ccc-bd55-ec47ad889c01 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:24.542942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 506/1002] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:24.545582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f17899-286f-472a-93ae-fb8bc75c81fc None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:24.584254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78835c-86ea-4bf1-97b7-5dbbae3b8dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:24.584992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78835c-86ea-4bf1-97b7-5dbbae3b8dbe None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:24.585270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78835c-86ea-4bf1-97b7-5dbbae3b8dbe None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:24.585539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78835c-86ea-4bf1-97b7-5dbbae3b8dbe None admin] PATH_INFO: `/v3/services/compute` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:24.586245 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78835c-86ea-4bf1-97b7-5dbbae3b8dbe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:24.587653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78835c-86ea-4bf1-97b7-5dbbae3b8dbe None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:24.599527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-0e78835c-86ea-4bf1-97b7-5dbbae3b8dbe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:40:24.600988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 497/1003] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:24.607181 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750bb8-f544-4ccc-bd55-ec47ad889c01 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:24.715534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750bb8-f544-4ccc-bd55-ec47ad889c01 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:24.749679 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842fde3-909a-4baa-a6fa-bf7aef07d94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:24.750373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842fde3-909a-4baa-a6fa-bf7aef07d94f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:24.750654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842fde3-909a-4baa-a6fa-bf7aef07d94f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:24.750947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842fde3-909a-4baa-a6fa-bf7aef07d94f None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:24.751662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842fde3-909a-4baa-a6fa-bf7aef07d94f None admin] RBAC: Adding query filter params (name=compute) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:24.751967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842fde3-909a-4baa-a6fa-bf7aef07d94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:24.753349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842fde3-909a-4baa-a6fa-bf7aef07d94f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:24.758153 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 507/1004] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:40:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:24.763991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78835c-86ea-4bf1-97b7-5dbbae3b8dbe None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:24.859606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78835c-86ea-4bf1-97b7-5dbbae3b8dbe None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:24.892989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd0746-1345-4755-88d9-3519d797711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:24.893669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd0746-1345-4755-88d9-3519d797711a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:24.893957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd0746-1345-4755-88d9-3519d797711a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:24.894266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd0746-1345-4755-88d9-3519d797711a None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:24.894984 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd0746-1345-4755-88d9-3519d797711a None admin] RBAC: Adding query filter params (type=compute) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:24.895290 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd0746-1345-4755-88d9-3519d797711a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:24.896667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd0746-1345-4755-88d9-3519d797711a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:24.901852 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 498/1005] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:40:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:24.907986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842fde3-909a-4baa-a6fa-bf7aef07d94f None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:25.007799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842fde3-909a-4baa-a6fa-bf7aef07d94f None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:25.041066 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ff85-2ffd-45e8-b582-00fa5d02c0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:25.041732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ff85-2ffd-45e8-b582-00fa5d02c0be None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:25.042013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ff85-2ffd-45e8-b582-00fa5d02c0be None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:25.042557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ff85-2ffd-45e8-b582-00fa5d02c0be None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:25.043108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ff85-2ffd-45e8-b582-00fa5d02c0be None admin] RBAC: Adding query filter params (interface=public, service_id=2331ef56484f467babaf32120adbfd0a, region_id=RegionOne) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:25.043419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ff85-2ffd-45e8-b582-00fa5d02c0be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:25.045221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ff85-2ffd-45e8-b582-00fa5d02c0be None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:25.050573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 508/1006] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Oct 28 19:40:24 2022] GET /identity/v3/endpoints?service_id=2331ef56484f467babaf32120adbfd0a&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:25.056255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd0746-1345-4755-88d9-3519d797711a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:25.153676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd0746-1345-4755-88d9-3519d797711a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:25.188164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ce7e0-925a-4c12-9245-c5283119a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:25.188884 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ce7e0-925a-4c12-9245-c5283119a2cf None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:25.189140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ce7e0-925a-4c12-9245-c5283119a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:25.189439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ce7e0-925a-4c12-9245-c5283119a2cf None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:25.190191 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ce7e0-925a-4c12-9245-c5283119a2cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:25.191611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ce7e0-925a-4c12-9245-c5283119a2cf None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:25.198570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 499/1007] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Oct 28 19:40:25 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:40:26.557783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6e6c-3756-42dc-8456-fcb9c33e711b None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:26.558384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6e6c-3756-42dc-8456-fcb9c33e711b None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:26.558384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6e6c-3756-42dc-8456-fcb9c33e711b None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:26.560337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 509/1008] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:26.565671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d4198-22dd-4c45-9708-a8f1beb9738d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:26.566112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d4198-22dd-4c45-9708-a8f1beb9738d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:26.566287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d4198-22dd-4c45-9708-a8f1beb9738d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:26.583391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-901d4198-22dd-4c45-9708-a8f1beb9738d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:26.584549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-901d4198-22dd-4c45-9708-a8f1beb9738d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:26.658408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 500/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:26.677614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6e6c-3756-42dc-8456-fcb9c33e711b None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:26.784187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6e6c-3756-42dc-8456-fcb9c33e711b None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:26.816584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64a179-c617-4c10-b6b9-ea428951d650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:26.817309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a179-c617-4c10-b6b9-ea428951d650 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:26.817580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a179-c617-4c10-b6b9-ea428951d650 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:26.817847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a179-c617-4c10-b6b9-ea428951d650 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:26.819035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64a179-c617-4c10-b6b9-ea428951d650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:26.820495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64a179-c617-4c10-b6b9-ea428951d650 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:26.822337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 510/1010] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:26.828098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d4198-22dd-4c45-9708-a8f1beb9738d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:26.881650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8756103-925d-4fa7-8482-5709c8e53a57 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:26.882014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8756103-925d-4fa7-8482-5709c8e53a57 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:26.882229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8756103-925d-4fa7-8482-5709c8e53a57 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:26.884189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 511/1011] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:26.889036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687234d-36d8-40f8-924b-416e876b829d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:26.889339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687234d-36d8-40f8-924b-416e876b829d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:26.889613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687234d-36d8-40f8-924b-416e876b829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:26.908054 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4687234d-36d8-40f8-924b-416e876b829d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:26.909214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4687234d-36d8-40f8-924b-416e876b829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:26.924401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d4198-22dd-4c45-9708-a8f1beb9738d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:26.957680 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1db112-2147-4041-8e93-c787cb8005f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:26.958389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db112-2147-4041-8e93-c787cb8005f7 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:26.958670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db112-2147-4041-8e93-c787cb8005f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:26.958959 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db112-2147-4041-8e93-c787cb8005f7 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:26.959667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1db112-2147-4041-8e93-c787cb8005f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:26.961112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1db112-2147-4041-8e93-c787cb8005f7 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:26.979491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 512/1012] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:26.990608 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 501/1013] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:40:26 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:27.007210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687234d-36d8-40f8-924b-416e876b829d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:27.112753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687234d-36d8-40f8-924b-416e876b829d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:27.149179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf28a6-02c9-4a19-a87b-ed462c51cb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:27.149860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf28a6-02c9-4a19-a87b-ed462c51cb62 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:27.150161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf28a6-02c9-4a19-a87b-ed462c51cb62 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:27.150441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf28a6-02c9-4a19-a87b-ed462c51cb62 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:27.151211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf28a6-02c9-4a19-a87b-ed462c51cb62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:27.152634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf28a6-02c9-4a19-a87b-ed462c51cb62 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:27.170027 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 513/1014] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:40:27 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:27.537497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d474bd-f82d-4970-bdb7-bff93794dc95 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:27.537883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d474bd-f82d-4970-bdb7-bff93794dc95 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:27.538110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d474bd-f82d-4970-bdb7-bff93794dc95 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:27.539897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 502/1015] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:27.545721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6368-f742-4bc1-9ce4-6746df004393 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:27.546003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6368-f742-4bc1-9ce4-6746df004393 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:27.546305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6368-f742-4bc1-9ce4-6746df004393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:27.563482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ad1d6368-f742-4bc1-9ce4-6746df004393 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:27.564670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ad1d6368-f742-4bc1-9ce4-6746df004393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:27.633202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 514/1016] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:27 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:27.656087 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d474bd-f82d-4970-bdb7-bff93794dc95 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:27.753476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d474bd-f82d-4970-bdb7-bff93794dc95 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:27.785325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a45e03-902a-42b2-8043-cdc225fe4f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:27.786145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a45e03-902a-42b2-8043-cdc225fe4f16 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:27.786432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a45e03-902a-42b2-8043-cdc225fe4f16 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:27.786696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a45e03-902a-42b2-8043-cdc225fe4f16 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:27.787333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a45e03-902a-42b2-8043-cdc225fe4f16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:27.788753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a45e03-902a-42b2-8043-cdc225fe4f16 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:27.799780 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-12a45e03-902a-42b2-8043-cdc225fe4f16 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:40:27.801103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 503/1017] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:27.807113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d6368-f742-4bc1-9ce4-6746df004393 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:27.902594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d6368-f742-4bc1-9ce4-6746df004393 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:27.937948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed5d78-fda0-4a8f-a90e-0a4a80f938bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:27.938643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed5d78-fda0-4a8f-a90e-0a4a80f938bd None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:27.938920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed5d78-fda0-4a8f-a90e-0a4a80f938bd None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:27.939189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed5d78-fda0-4a8f-a90e-0a4a80f938bd None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:27.939890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed5d78-fda0-4a8f-a90e-0a4a80f938bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:27.940189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed5d78-fda0-4a8f-a90e-0a4a80f938bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:27.941554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed5d78-fda0-4a8f-a90e-0a4a80f938bd None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:27.946602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 515/1018] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:40:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:27.952430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a45e03-902a-42b2-8043-cdc225fe4f16 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:28.047809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a45e03-902a-42b2-8043-cdc225fe4f16 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:28.081554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6306e-7394-4441-b0ea-5864a72d21ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:28.082239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6306e-7394-4441-b0ea-5864a72d21ef None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:28.082554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6306e-7394-4441-b0ea-5864a72d21ef None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:28.082829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6306e-7394-4441-b0ea-5864a72d21ef None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:28.083524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6306e-7394-4441-b0ea-5864a72d21ef None admin] RBAC: Adding query filter params (type=compute) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:28.083827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6306e-7394-4441-b0ea-5864a72d21ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:28.085196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6306e-7394-4441-b0ea-5864a72d21ef None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:28.094897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 504/1019] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Oct 28 19:40:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:28.096606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed5d78-fda0-4a8f-a90e-0a4a80f938bd None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:28.196110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed5d78-fda0-4a8f-a90e-0a4a80f938bd None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:28.229668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad483916-d89d-4ffb-916a-942dd7382d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:28.230356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad483916-d89d-4ffb-916a-942dd7382d2c None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:28.230634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad483916-d89d-4ffb-916a-942dd7382d2c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:28.230902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad483916-d89d-4ffb-916a-942dd7382d2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:28.231649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad483916-d89d-4ffb-916a-942dd7382d2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:28.233162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad483916-d89d-4ffb-916a-942dd7382d2c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:28.258119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 516/1020] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:40:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:40:29.366753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc22f4-7af9-4ce5-a2f3-a9f99b8e7d9f None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:29.367374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc22f4-7af9-4ce5-a2f3-a9f99b8e7d9f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:29.367374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc22f4-7af9-4ce5-a2f3-a9f99b8e7d9f None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:29.369275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 505/1021] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:29.374527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028e7c9-b9fa-43f7-bf48-bbe8c86c05a6 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:29.374936 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028e7c9-b9fa-43f7-bf48-bbe8c86c05a6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:29.375122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028e7c9-b9fa-43f7-bf48-bbe8c86c05a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:29.392401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2028e7c9-b9fa-43f7-bf48-bbe8c86c05a6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:29.393588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2028e7c9-b9fa-43f7-bf48-bbe8c86c05a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:29.465442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 517/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:29.490468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc22f4-7af9-4ce5-a2f3-a9f99b8e7d9f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:29.519996 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a6f4-f0b2-4bef-a254-e32b62668de0 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:29.520325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a6f4-f0b2-4bef-a254-e32b62668de0 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:29.520572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30a6f4-f0b2-4bef-a254-e32b62668de0 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:29.522592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 518/1023] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:29.527238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4b625-b9db-4cf3-a3be-768aea368281 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:29.527522 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4b625-b9db-4cf3-a3be-768aea368281 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:29.527801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4b625-b9db-4cf3-a3be-768aea368281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:29.545004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-48e4b625-b9db-4cf3-a3be-768aea368281 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:29.546202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-48e4b625-b9db-4cf3-a3be-768aea368281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:29.592083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc22f4-7af9-4ce5-a2f3-a9f99b8e7d9f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:29.610408 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 519/1024] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:29.623941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6319e-80e6-492e-bc04-3897bd031fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:29.624687 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6319e-80e6-492e-bc04-3897bd031fc9 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:29.624968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6319e-80e6-492e-bc04-3897bd031fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:29.625240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6319e-80e6-492e-bc04-3897bd031fc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:29.626431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6319e-80e6-492e-bc04-3897bd031fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:29.627900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6319e-80e6-492e-bc04-3897bd031fc9 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:29.629682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 506/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:29.635140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6319e-80e6-492e-bc04-3897bd031fc9 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:29.635275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4b625-b9db-4cf3-a3be-768aea368281 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:29.733115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4b625-b9db-4cf3-a3be-768aea368281 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:29.737926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6319e-80e6-492e-bc04-3897bd031fc9 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:29.766174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd68fb7-428e-4621-87c7-b048a99bf872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:29.767064 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd68fb7-428e-4621-87c7-b048a99bf872 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:29.767343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd68fb7-428e-4621-87c7-b048a99bf872 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:29.767625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd68fb7-428e-4621-87c7-b048a99bf872 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:29.768435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd68fb7-428e-4621-87c7-b048a99bf872 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:29.769895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd68fb7-428e-4621-87c7-b048a99bf872 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:29.770316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0f246-9ec7-4e8d-9347-21111eb7137f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:29.771108 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0f246-9ec7-4e8d-9347-21111eb7137f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:29.771483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0f246-9ec7-4e8d-9347-21111eb7137f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:29.771758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0f246-9ec7-4e8d-9347-21111eb7137f None admin] PATH_INFO: `/v3/services/image` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:29.772403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0f246-9ec7-4e8d-9347-21111eb7137f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:29.773757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0f246-9ec7-4e8d-9347-21111eb7137f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:29.785455 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-88c0f246-9ec7-4e8d-9347-21111eb7137f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:40:29.786968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 507/1026] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Oct 28 19:40:29 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:29.798344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 520/1027] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:40:29 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:29.798586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0f246-9ec7-4e8d-9347-21111eb7137f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:29.901962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0f246-9ec7-4e8d-9347-21111eb7137f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:29.938260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34643500-3f42-4b16-b241-4f5821a15468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:29.938962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643500-3f42-4b16-b241-4f5821a15468 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:29.939241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643500-3f42-4b16-b241-4f5821a15468 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:29.939519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643500-3f42-4b16-b241-4f5821a15468 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:29.940236 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34643500-3f42-4b16-b241-4f5821a15468 None admin] RBAC: Adding query filter params (name=image) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:29.940540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34643500-3f42-4b16-b241-4f5821a15468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:29.941960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34643500-3f42-4b16-b241-4f5821a15468 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:29.947480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 508/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:29.953693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd68fb7-428e-4621-87c7-b048a99bf872 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:30.056150 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd68fb7-428e-4621-87c7-b048a99bf872 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:30.089391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f73f0-d323-445c-888b-4d3ddaaaa65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:30.090436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f73f0-d323-445c-888b-4d3ddaaaa65a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:30.090894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f73f0-d323-445c-888b-4d3ddaaaa65a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:30.091466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f73f0-d323-445c-888b-4d3ddaaaa65a None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:30.092355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f73f0-d323-445c-888b-4d3ddaaaa65a None admin] RBAC: Adding query filter params (type=image) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:30.092860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f73f0-d323-445c-888b-4d3ddaaaa65a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:30.094565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f73f0-d323-445c-888b-4d3ddaaaa65a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:30.099884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 521/1029] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:30.106072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34643500-3f42-4b16-b241-4f5821a15468 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:30.208588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34643500-3f42-4b16-b241-4f5821a15468 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:30.241882 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53c45f-7782-4f7d-a235-7fca7456f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:30.242582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53c45f-7782-4f7d-a235-7fca7456f369 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:30.242914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53c45f-7782-4f7d-a235-7fca7456f369 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:30.243190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53c45f-7782-4f7d-a235-7fca7456f369 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:30.243987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53c45f-7782-4f7d-a235-7fca7456f369 None admin] RBAC: Adding query filter params (interface=public, service_id=3ab56705b3c840bca4f94a5e66b27a94, region_id=RegionOne) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:30.244297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53c45f-7782-4f7d-a235-7fca7456f369 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:30.245688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53c45f-7782-4f7d-a235-7fca7456f369 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:30.251042 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 509/1030] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Oct 28 19:40:30 2022] GET /identity/v3/endpoints?service_id=3ab56705b3c840bca4f94a5e66b27a94&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:30.256626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f73f0-d323-445c-888b-4d3ddaaaa65a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:30.360617 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f73f0-d323-445c-888b-4d3ddaaaa65a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:30.393882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ad93d-b83c-48da-a72e-33c24e3598a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:30.394676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ad93d-b83c-48da-a72e-33c24e3598a3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:30.394852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ad93d-b83c-48da-a72e-33c24e3598a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:30.395134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ad93d-b83c-48da-a72e-33c24e3598a3 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:30.395819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ad93d-b83c-48da-a72e-33c24e3598a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:30.397205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ad93d-b83c-48da-a72e-33c24e3598a3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:30.403788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 522/1031] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Oct 28 19:40:30 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:40:30.661954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d72d9-749e-4498-a175-851dfe0a5307 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:30.662513 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d72d9-749e-4498-a175-851dfe0a5307 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:30.662513 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d72d9-749e-4498-a175-851dfe0a5307 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:30.664476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 510/1032] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:30.670118 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c84df-1784-4a1b-835f-ec3354e5953e None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:30.670399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c84df-1784-4a1b-835f-ec3354e5953e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:30.670710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c84df-1784-4a1b-835f-ec3354e5953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:30.689787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2b0c84df-1784-4a1b-835f-ec3354e5953e None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:30.690980 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2b0c84df-1784-4a1b-835f-ec3354e5953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:30.760834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 523/1033] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:30.784654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d72d9-749e-4498-a175-851dfe0a5307 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:30.885019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d72d9-749e-4498-a175-851dfe0a5307 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:30.917493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c4a6f-8113-4728-b1a0-25f28aa8a929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:30.918276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4a6f-8113-4728-b1a0-25f28aa8a929 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:30.918555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4a6f-8113-4728-b1a0-25f28aa8a929 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:30.919227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4a6f-8113-4728-b1a0-25f28aa8a929 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:30.929512 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c4a6f-8113-4728-b1a0-25f28aa8a929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:30.936993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-510c4a6f-8113-4728-b1a0-25f28aa8a929 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:40:30.938373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 511/1034] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Oct 28 19:40:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:30.944521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c84df-1784-4a1b-835f-ec3354e5953e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:31.046528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c84df-1784-4a1b-835f-ec3354e5953e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:31.080061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce40f-060b-4615-8bba-5c2db548aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:31.080833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce40f-060b-4615-8bba-5c2db548aea5 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:31.081110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce40f-060b-4615-8bba-5c2db548aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:31.081384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce40f-060b-4615-8bba-5c2db548aea5 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:31.082160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce40f-060b-4615-8bba-5c2db548aea5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:31.082461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce40f-060b-4615-8bba-5c2db548aea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:31.083836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce40f-060b-4615-8bba-5c2db548aea5 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:31.092348 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 524/1035] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Oct 28 19:40:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:31.098140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c4a6f-8113-4728-b1a0-25f28aa8a929 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:31.193892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c4a6f-8113-4728-b1a0-25f28aa8a929 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:31.226235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520196-a08f-487a-9060-4ac3502d4558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:31.227053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520196-a08f-487a-9060-4ac3502d4558 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:31.227334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520196-a08f-487a-9060-4ac3502d4558 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:31.227607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520196-a08f-487a-9060-4ac3502d4558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:31.238216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1520196-a08f-487a-9060-4ac3502d4558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:31.239662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1520196-a08f-487a-9060-4ac3502d4558 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:31.255764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-c1520196-a08f-487a-9060-4ac3502d4558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:31.261663 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 512/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:31.263313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce40f-060b-4615-8bba-5c2db548aea5 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:31.359305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce40f-060b-4615-8bba-5c2db548aea5 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:31.391143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e5234-7df9-4b30-a104-2299632920ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:31.391805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e5234-7df9-4b30-a104-2299632920ad None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:31.392088 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e5234-7df9-4b30-a104-2299632920ad None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:31.392357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e5234-7df9-4b30-a104-2299632920ad None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:31.393213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e5234-7df9-4b30-a104-2299632920ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:31.393510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e5234-7df9-4b30-a104-2299632920ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:31.394898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e5234-7df9-4b30-a104-2299632920ad None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:31.406901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 525/1037] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:31.412630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520196-a08f-487a-9060-4ac3502d4558 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:31.514351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520196-a08f-487a-9060-4ac3502d4558 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:31.551024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76b52-5b54-42ff-abcd-fd7ed6cccdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:31.551833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76b52-5b54-42ff-abcd-fd7ed6cccdea None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:31.552117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76b52-5b54-42ff-abcd-fd7ed6cccdea None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:31.552391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76b52-5b54-42ff-abcd-fd7ed6cccdea None admin] PATH_INFO: `/v3/users/nova` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:31.560561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced76b52-5b54-42ff-abcd-fd7ed6cccdea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:31.562015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced76b52-5b54-42ff-abcd-fd7ed6cccdea None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:31.575771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-ced76b52-5b54-42ff-abcd-fd7ed6cccdea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:40:31.577156 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 513/1038] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Oct 28 19:40:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:31.583019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e5234-7df9-4b30-a104-2299632920ad None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:31.683001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e5234-7df9-4b30-a104-2299632920ad None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:31.716625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42719e-88b1-4ff1-bac6-446b310d92e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:31.717644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42719e-88b1-4ff1-bac6-446b310d92e3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:31.718155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42719e-88b1-4ff1-bac6-446b310d92e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:31.718825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42719e-88b1-4ff1-bac6-446b310d92e3 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:31.719883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42719e-88b1-4ff1-bac6-446b310d92e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:31.720388 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42719e-88b1-4ff1-bac6-446b310d92e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:31.722466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42719e-88b1-4ff1-bac6-446b310d92e3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:31.740043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 526/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Oct 28 19:40:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:31.746011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76b52-5b54-42ff-abcd-fd7ed6cccdea None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:31.851702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76b52-5b54-42ff-abcd-fd7ed6cccdea None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:31.886573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5200b19-846a-488f-82df-621a334dddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:31.887638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5200b19-846a-488f-82df-621a334dddf0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:31.888144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5200b19-846a-488f-82df-621a334dddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:31.888591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5200b19-846a-488f-82df-621a334dddf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:31.956345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5200b19-846a-488f-82df-621a334dddf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:31.958236 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5200b19-846a-488f-82df-621a334dddf0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:32.053664 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 514/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 19:40:32.059571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42719e-88b1-4ff1-bac6-446b310d92e3 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:32.157694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42719e-88b1-4ff1-bac6-446b310d92e3 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:32.170302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6df6a-02b3-48ac-80d3-c9071a9e1866 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.170629 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6df6a-02b3-48ac-80d3-c9071a9e1866 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.170814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6df6a-02b3-48ac-80d3-c9071a9e1866 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.172871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 515/1041] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:32.178329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547db9ca-456e-4cef-988b-ab1e90d06819 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.178638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547db9ca-456e-4cef-988b-ab1e90d06819 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.178903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547db9ca-456e-4cef-988b-ab1e90d06819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.192808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607a3b0-d754-4b0a-8525-f038513af410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:32.193613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607a3b0-d754-4b0a-8525-f038513af410 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.193890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607a3b0-d754-4b0a-8525-f038513af410 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.194198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607a3b0-d754-4b0a-8525-f038513af410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.195663 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-547db9ca-456e-4cef-988b-ab1e90d06819 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:32.196808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-547db9ca-456e-4cef-988b-ab1e90d06819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:32.204448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607a3b0-d754-4b0a-8525-f038513af410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:32.205915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607a3b0-d754-4b0a-8525-f038513af410 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:32.222902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-e607a3b0-d754-4b0a-8525-f038513af410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:32.229084 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 527/1042] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:32.229856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607a3b0-d754-4b0a-8525-f038513af410 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:32.261221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 516/1043] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:32.285246 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547db9ca-456e-4cef-988b-ab1e90d06819 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:32.325689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607a3b0-d754-4b0a-8525-f038513af410 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:32.358231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebfcb6-5668-4dfb-80c3-7bca875bcdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:32.358921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebfcb6-5668-4dfb-80c3-7bca875bcdc1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.359197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebfcb6-5668-4dfb-80c3-7bca875bcdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.359463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebfcb6-5668-4dfb-80c3-7bca875bcdc1 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.360214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebfcb6-5668-4dfb-80c3-7bca875bcdc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:32.360504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebfcb6-5668-4dfb-80c3-7bca875bcdc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:32.361964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebfcb6-5668-4dfb-80c3-7bca875bcdc1 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:32.374759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 528/1044] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:32.382312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebfcb6-5668-4dfb-80c3-7bca875bcdc1 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:32.388480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547db9ca-456e-4cef-988b-ab1e90d06819 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:32.428359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61292423-62ab-4257-a837-92acec2d05d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:32.429661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61292423-62ab-4257-a837-92acec2d05d4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.430271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61292423-62ab-4257-a837-92acec2d05d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.430956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61292423-62ab-4257-a837-92acec2d05d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.442564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61292423-62ab-4257-a837-92acec2d05d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:32.449467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-61292423-62ab-4257-a837-92acec2d05d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:40:32.451378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 517/1045] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:40:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:32.456727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61292423-62ab-4257-a837-92acec2d05d4 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:32.480438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebfcb6-5668-4dfb-80c3-7bca875bcdc1 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:32.514503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502ba32-9d2f-4a80-b145-f7fa57a69962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:32.515339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502ba32-9d2f-4a80-b145-f7fa57a69962 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.515629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502ba32-9d2f-4a80-b145-f7fa57a69962 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.515907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502ba32-9d2f-4a80-b145-f7fa57a69962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.522501 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502ba32-9d2f-4a80-b145-f7fa57a69962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:32.523971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502ba32-9d2f-4a80-b145-f7fa57a69962 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:32.537488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c502ba32-9d2f-4a80-b145-f7fa57a69962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:32.538901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 529/1046] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:32.544829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502ba32-9d2f-4a80-b145-f7fa57a69962 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:32.553186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61292423-62ab-4257-a837-92acec2d05d4 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:32.590261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c1655-99dc-46c7-b988-a89773982952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:32.591002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1655-99dc-46c7-b988-a89773982952 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.591284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1655-99dc-46c7-b988-a89773982952 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.591560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1655-99dc-46c7-b988-a89773982952 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.592305 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c1655-99dc-46c7-b988-a89773982952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:32.592613 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c1655-99dc-46c7-b988-a89773982952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:32.593998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c1655-99dc-46c7-b988-a89773982952 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:32.602019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 518/1047] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:40:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:32.608010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c1655-99dc-46c7-b988-a89773982952 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:32.660144 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502ba32-9d2f-4a80-b145-f7fa57a69962 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:32.693975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778f81e-24ad-4a96-9fe3-abb92bbc8def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:32.694596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778f81e-24ad-4a96-9fe3-abb92bbc8def None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.694877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778f81e-24ad-4a96-9fe3-abb92bbc8def None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.695148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778f81e-24ad-4a96-9fe3-abb92bbc8def None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.695950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778f81e-24ad-4a96-9fe3-abb92bbc8def None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:32.696249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778f81e-24ad-4a96-9fe3-abb92bbc8def None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:32.697717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778f81e-24ad-4a96-9fe3-abb92bbc8def None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:32.709472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 530/1048] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:32.715380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778f81e-24ad-4a96-9fe3-abb92bbc8def None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:32.722263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c1655-99dc-46c7-b988-a89773982952 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:32.757124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519b09b-1fc6-458e-aedd-9087d3ed1758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:32.758011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519b09b-1fc6-458e-aedd-9087d3ed1758 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.758382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519b09b-1fc6-458e-aedd-9087d3ed1758 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.758664 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519b09b-1fc6-458e-aedd-9087d3ed1758 None admin] PATH_INFO: `/v3/users/2743bbeafb184d6ab33c67356ebb35de` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.772447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519b09b-1fc6-458e-aedd-9087d3ed1758 None admin] RBAC: Authorizing `identity:get_user(user_id=2743bbeafb184d6ab33c67356ebb35de)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:32.773914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519b09b-1fc6-458e-aedd-9087d3ed1758 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:32.775698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 519/1049] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:40:32 2022] GET /identity/v3/users/2743bbeafb184d6ab33c67356ebb35de => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:32.776967 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a5c16-6887-4a8b-bc02-c30b5e65dec0 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.777248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a5c16-6887-4a8b-bc02-c30b5e65dec0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.777513 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a5c16-6887-4a8b-bc02-c30b5e65dec0 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.779400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 520/1050] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:32.781305 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a5c16-6887-4a8b-bc02-c30b5e65dec0 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:32.811697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778f81e-24ad-4a96-9fe3-abb92bbc8def None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:32.843920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d911f3-29f3-455a-99b4-7f1c1d82b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:32.844575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d911f3-29f3-455a-99b4-7f1c1d82b35f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.844851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d911f3-29f3-455a-99b4-7f1c1d82b35f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.845122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d911f3-29f3-455a-99b4-7f1c1d82b35f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.845945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d911f3-29f3-455a-99b4-7f1c1d82b35f None admin] RBAC: Adding query filter params (role.id=5d9f5b21f518437b9d6a33ac52315fb6, scope.project.id=e91226b635934bfcb949577491791af4, user.id=be7be85d70b64273b7904082ee2ba848) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:32.846286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d911f3-29f3-455a-99b4-7f1c1d82b35f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:32.847711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d911f3-29f3-455a-99b4-7f1c1d82b35f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:32.852955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 531/1051] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:32 2022] GET /identity/v3/role_assignments?user.id=be7be85d70b64273b7904082ee2ba848&scope.project.id=e91226b635934bfcb949577491791af4&role.id=5d9f5b21f518437b9d6a33ac52315fb6 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:32.861514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beac54-7c93-4881-92bc-9a58054cebd1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.861514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beac54-7c93-4881-92bc-9a58054cebd1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.861514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beac54-7c93-4881-92bc-9a58054cebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.878109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-79beac54-7c93-4881-92bc-9a58054cebd1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:32.879361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-79beac54-7c93-4881-92bc-9a58054cebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:32.881417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a5c16-6887-4a8b-bc02-c30b5e65dec0 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:32.921422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b7e0b-e728-46d9-92a7-6d3202072bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:32.922107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b7e0b-e728-46d9-92a7-6d3202072bd0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:32.922413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b7e0b-e728-46d9-92a7-6d3202072bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:32.922688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b7e0b-e728-46d9-92a7-6d3202072bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:32.953406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 532/1052] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:32.976929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beac54-7c93-4881-92bc-9a58054cebd1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:32.995016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b7e0b-e728-46d9-92a7-6d3202072bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:32.996519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b7e0b-e728-46d9-92a7-6d3202072bd0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:33.081943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beac54-7c93-4881-92bc-9a58054cebd1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:33.101938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 521/1053] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:32 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:33.103031 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b7e0b-e728-46d9-92a7-6d3202072bd0 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:33.115155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49796c1-29fd-4c78-abc6-21ce45b7b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:33.115962 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49796c1-29fd-4c78-abc6-21ce45b7b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:33.116354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49796c1-29fd-4c78-abc6-21ce45b7b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:33.116625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49796c1-29fd-4c78-abc6-21ce45b7b0a7 None admin] PATH_INFO: `/v3/services/image` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:33.117296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49796c1-29fd-4c78-abc6-21ce45b7b0a7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:33.118724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49796c1-29fd-4c78-abc6-21ce45b7b0a7 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:33.129417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-e49796c1-29fd-4c78-abc6-21ce45b7b0a7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:40:33.130643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 533/1054] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Oct 28 19:40:32 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:33.136592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49796c1-29fd-4c78-abc6-21ce45b7b0a7 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:33.204347 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b7e0b-e728-46d9-92a7-6d3202072bd0 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:33.232519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49796c1-29fd-4c78-abc6-21ce45b7b0a7 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:33.238726 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301a844-2ef1-4066-bae4-c8fba3a21492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:33.240043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301a844-2ef1-4066-bae4-c8fba3a21492 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:33.240336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301a844-2ef1-4066-bae4-c8fba3a21492 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:33.240572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301a844-2ef1-4066-bae4-c8fba3a21492 None admin] PATH_INFO: `/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:33.242143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301a844-2ef1-4066-bae4-c8fba3a21492 None admin] RBAC: Authorizing `identity:get_project(project_id=5e10e5a1130b462cb812ba3ee2875d5d)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:33.244294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301a844-2ef1-4066-bae4-c8fba3a21492 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:33.252051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 522/1055] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:40:33 2022] GET /identity/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:33.253204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301a844-2ef1-4066-bae4-c8fba3a21492 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:33.265375 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dd49e-76b5-4df5-b9de-dc55220bf89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:33.266017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dd49e-76b5-4df5-b9de-dc55220bf89b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:33.266338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dd49e-76b5-4df5-b9de-dc55220bf89b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:33.266610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dd49e-76b5-4df5-b9de-dc55220bf89b None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:33.267321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dd49e-76b5-4df5-b9de-dc55220bf89b None admin] RBAC: Adding query filter params (name=image) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:33.267646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dd49e-76b5-4df5-b9de-dc55220bf89b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:33.269003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dd49e-76b5-4df5-b9de-dc55220bf89b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:33.273973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 534/1056] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:33.279825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dd49e-76b5-4df5-b9de-dc55220bf89b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:33.353114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301a844-2ef1-4066-bae4-c8fba3a21492 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:33.374477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dd49e-76b5-4df5-b9de-dc55220bf89b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:33.385896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fb8d4-bf70-4b74-8713-8bab79078396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:33.386581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fb8d4-bf70-4b74-8713-8bab79078396 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:33.386865 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fb8d4-bf70-4b74-8713-8bab79078396 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:33.387135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fb8d4-bf70-4b74-8713-8bab79078396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:33.388029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fb8d4-bf70-4b74-8713-8bab79078396 None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=5e10e5a1130b462cb812ba3ee2875d5d, user.id=2743bbeafb184d6ab33c67356ebb35de) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:33.388339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fb8d4-bf70-4b74-8713-8bab79078396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:33.389771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fb8d4-bf70-4b74-8713-8bab79078396 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:33.406162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 523/1057] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:33 2022] GET /identity/v3/role_assignments?user.id=2743bbeafb184d6ab33c67356ebb35de&scope.project.id=5e10e5a1130b462cb812ba3ee2875d5d&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:33.409198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbef4ca-9552-461f-b18b-b2f16e789849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:33.409977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbef4ca-9552-461f-b18b-b2f16e789849 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:33.410357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbef4ca-9552-461f-b18b-b2f16e789849 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:33.410702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbef4ca-9552-461f-b18b-b2f16e789849 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:33.411506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbef4ca-9552-461f-b18b-b2f16e789849 None admin] RBAC: Adding query filter params (type=image) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:33.411885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbef4ca-9552-461f-b18b-b2f16e789849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:33.413420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbef4ca-9552-461f-b18b-b2f16e789849 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:33.422140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 535/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:33.426019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fb8d4-bf70-4b74-8713-8bab79078396 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:33.528600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fb8d4-bf70-4b74-8713-8bab79078396 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:33.566320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c39eca-2873-4257-9cf7-56704086bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:33.567022 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c39eca-2873-4257-9cf7-56704086bf7e None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:33.567296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c39eca-2873-4257-9cf7-56704086bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:33.567565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c39eca-2873-4257-9cf7-56704086bf7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:33.568324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c39eca-2873-4257-9cf7-56704086bf7e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:33.569715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c39eca-2873-4257-9cf7-56704086bf7e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:33.591549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 524/1059] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:40:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:35.164444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c9d96-8d94-4f1f-af4a-18939190f6bb None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:35.165012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c9d96-8d94-4f1f-af4a-18939190f6bb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:35.165012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c9d96-8d94-4f1f-af4a-18939190f6bb None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:35.166958 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 536/1060] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:35.172612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6b519-267a-4935-b587-e0a58c281316 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:35.173053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6b519-267a-4935-b587-e0a58c281316 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:35.173131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6b519-267a-4935-b587-e0a58c281316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:35.191151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-76a6b519-267a-4935-b587-e0a58c281316 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:35.192335 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-76a6b519-267a-4935-b587-e0a58c281316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:35.395162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 525/1061] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:35.417862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c9d96-8d94-4f1f-af4a-18939190f6bb None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:35.520991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c9d96-8d94-4f1f-af4a-18939190f6bb None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:35.555385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93b2d5-7122-46ac-bed0-1f1410558c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:35.556215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b2d5-7122-46ac-bed0-1f1410558c89 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:35.556459 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b2d5-7122-46ac-bed0-1f1410558c89 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:35.556828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93b2d5-7122-46ac-bed0-1f1410558c89 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:35.567874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93b2d5-7122-46ac-bed0-1f1410558c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:35.575798 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-fc93b2d5-7122-46ac-bed0-1f1410558c89 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:40:35.577342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 537/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Oct 28 19:40:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:35.583692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6b519-267a-4935-b587-e0a58c281316 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:35.694625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6b519-267a-4935-b587-e0a58c281316 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:35.696990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726568e0-4f51-4b5a-8434-f72fd42ae2ee None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:35.697546 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726568e0-4f51-4b5a-8434-f72fd42ae2ee None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:35.697875 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726568e0-4f51-4b5a-8434-f72fd42ae2ee None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:35.699908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 538/1063] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:35.705090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc3794-f575-42cc-92a5-72851934ef9a None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:35.705344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc3794-f575-42cc-92a5-72851934ef9a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:35.705788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc3794-f575-42cc-92a5-72851934ef9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:35.722840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-acfc3794-f575-42cc-92a5-72851934ef9a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:35.724024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-acfc3794-f575-42cc-92a5-72851934ef9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:35.733391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e4208-9bc9-4d21-9f57-5e9283a898d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:35.734216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e4208-9bc9-4d21-9f57-5e9283a898d5 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:35.734463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e4208-9bc9-4d21-9f57-5e9283a898d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:35.734756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e4208-9bc9-4d21-9f57-5e9283a898d5 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:35.735618 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e4208-9bc9-4d21-9f57-5e9283a898d5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:35.735899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e4208-9bc9-4d21-9f57-5e9283a898d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:35.737463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e4208-9bc9-4d21-9f57-5e9283a898d5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:35.751488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 526/1064] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Oct 28 19:40:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:35.752603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e4208-9bc9-4d21-9f57-5e9283a898d5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:35.798559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 539/1065] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:35.820932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc3794-f575-42cc-92a5-72851934ef9a None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:35.850507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e4208-9bc9-4d21-9f57-5e9283a898d5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:35.884579 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94df26f-7568-4d99-ad33-4d2e5c08b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:35.885383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94df26f-7568-4d99-ad33-4d2e5c08b81d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:35.885671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94df26f-7568-4d99-ad33-4d2e5c08b81d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:35.885939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94df26f-7568-4d99-ad33-4d2e5c08b81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:35.896060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94df26f-7568-4d99-ad33-4d2e5c08b81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:35.897628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94df26f-7568-4d99-ad33-4d2e5c08b81d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:35.915452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc3794-f575-42cc-92a5-72851934ef9a None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:35.916930 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a94df26f-7568-4d99-ad33-4d2e5c08b81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:35.919157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 527/1066] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:35.925038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94df26f-7568-4d99-ad33-4d2e5c08b81d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:35.950015 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6867a-4e4a-4a40-aee4-602c35bbf874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:35.950765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6867a-4e4a-4a40-aee4-602c35bbf874 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:35.951043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6867a-4e4a-4a40-aee4-602c35bbf874 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:35.951316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6867a-4e4a-4a40-aee4-602c35bbf874 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:35.961920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6867a-4e4a-4a40-aee4-602c35bbf874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:35.969003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-8dc6867a-4e4a-4a40-aee4-602c35bbf874 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:40:35.970185 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 540/1067] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:40:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:35.971386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29b6f-3aa0-4963-bd3b-e087e5791f8e None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:35.971668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29b6f-3aa0-4963-bd3b-e087e5791f8e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:35.972000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29b6f-3aa0-4963-bd3b-e087e5791f8e None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:35.974112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 541/1068] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:35.976364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada29b6f-3aa0-4963-bd3b-e087e5791f8e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.022378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94df26f-7568-4d99-ad33-4d2e5c08b81d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.055734 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2edfc0-4561-4db2-afec-5ae92cbab614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.056397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2edfc0-4561-4db2-afec-5ae92cbab614 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.056678 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2edfc0-4561-4db2-afec-5ae92cbab614 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.056953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2edfc0-4561-4db2-afec-5ae92cbab614 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.057667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2edfc0-4561-4db2-afec-5ae92cbab614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:36.057975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2edfc0-4561-4db2-afec-5ae92cbab614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.059461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2edfc0-4561-4db2-afec-5ae92cbab614 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.071048 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 528/1069] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:36.072239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ea16f-3837-4a84-9cc1-2bbade6327cb None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.072515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ea16f-3837-4a84-9cc1-2bbade6327cb None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.072783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ea16f-3837-4a84-9cc1-2bbade6327cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.076421 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada29b6f-3aa0-4963-bd3b-e087e5791f8e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.090439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-eb4ea16f-3837-4a84-9cc1-2bbade6327cb None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:36.091606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-eb4ea16f-3837-4a84-9cc1-2bbade6327cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:36.110522 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eabb8-4488-4733-8e23-42c1d21d0cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.111201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eabb8-4488-4733-8e23-42c1d21d0cdf None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.111478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eabb8-4488-4733-8e23-42c1d21d0cdf None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.111751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eabb8-4488-4733-8e23-42c1d21d0cdf None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.112503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eabb8-4488-4733-8e23-42c1d21d0cdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:36.112806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eabb8-4488-4733-8e23-42c1d21d0cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.114219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eabb8-4488-4733-8e23-42c1d21d0cdf None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.122649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 542/1070] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:40:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:36.123428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eabb8-4488-4733-8e23-42c1d21d0cdf None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.153932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 529/1071] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:36.154792 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ea16f-3837-4a84-9cc1-2bbade6327cb None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.217944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eabb8-4488-4733-8e23-42c1d21d0cdf None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.247236 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ea16f-3837-4a84-9cc1-2bbade6327cb None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.249258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fb3d4-213b-47c8-a981-0f1e45ac0ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.250051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fb3d4-213b-47c8-a981-0f1e45ac0ec5 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.250352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fb3d4-213b-47c8-a981-0f1e45ac0ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.250621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fb3d4-213b-47c8-a981-0f1e45ac0ec5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.257662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fb3d4-213b-47c8-a981-0f1e45ac0ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.259141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fb3d4-213b-47c8-a981-0f1e45ac0ec5 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.272543 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-e00fb3d4-213b-47c8-a981-0f1e45ac0ec5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:40:36.273890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 543/1072] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Oct 28 19:40:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:36.274544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fb3d4-213b-47c8-a981-0f1e45ac0ec5 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.281023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c405a-89d1-4600-a3c2-4f75db5717a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.281900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c405a-89d1-4600-a3c2-4f75db5717a0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.282212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c405a-89d1-4600-a3c2-4f75db5717a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.282482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c405a-89d1-4600-a3c2-4f75db5717a0 None admin] PATH_INFO: `/v3/users/2743bbeafb184d6ab33c67356ebb35de` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.283677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c405a-89d1-4600-a3c2-4f75db5717a0 None admin] RBAC: Authorizing `identity:get_user(user_id=2743bbeafb184d6ab33c67356ebb35de)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.285099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c405a-89d1-4600-a3c2-4f75db5717a0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.286727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 530/1073] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:40:36 2022] GET /identity/v3/users/2743bbeafb184d6ab33c67356ebb35de => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:36.287463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c405a-89d1-4600-a3c2-4f75db5717a0 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.371412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fb3d4-213b-47c8-a981-0f1e45ac0ec5 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.383700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c405a-89d1-4600-a3c2-4f75db5717a0 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.404496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bcf7b-aee6-45ef-b0ca-947f0755abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.405135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bcf7b-aee6-45ef-b0ca-947f0755abbd None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.405404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bcf7b-aee6-45ef-b0ca-947f0755abbd None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.405669 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bcf7b-aee6-45ef-b0ca-947f0755abbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.416864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4b88-89dd-4050-b72e-472361dbc50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.417528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4b88-89dd-4050-b72e-472361dbc50d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.417806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4b88-89dd-4050-b72e-472361dbc50d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.418552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4b88-89dd-4050-b72e-472361dbc50d None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.419389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4b88-89dd-4050-b72e-472361dbc50d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:36.419688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4b88-89dd-4050-b72e-472361dbc50d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.421115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4b88-89dd-4050-b72e-472361dbc50d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.438500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 531/1074] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Oct 28 19:40:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:36.439350 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4b88-89dd-4050-b72e-472361dbc50d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.470350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bcf7b-aee6-45ef-b0ca-947f0755abbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.471701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bcf7b-aee6-45ef-b0ca-947f0755abbd None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.532410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4b88-89dd-4050-b72e-472361dbc50d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.566729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88051bcc-1b8c-4c89-ac5e-203a008cb66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.567678 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051bcc-1b8c-4c89-ac5e-203a008cb66a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.568029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051bcc-1b8c-4c89-ac5e-203a008cb66a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.568149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 544/1075] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:36.568359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051bcc-1b8c-4c89-ac5e-203a008cb66a None admin] PATH_INFO: `/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.568860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bcf7b-aee6-45ef-b0ca-947f0755abbd None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.569792 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88051bcc-1b8c-4c89-ac5e-203a008cb66a None admin] RBAC: Authorizing `identity:get_project(project_id=5e10e5a1130b462cb812ba3ee2875d5d)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.571371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88051bcc-1b8c-4c89-ac5e-203a008cb66a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.573298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 532/1076] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:40:36 2022] GET /identity/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:36.574008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88051bcc-1b8c-4c89-ac5e-203a008cb66a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.666865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bcf7b-aee6-45ef-b0ca-947f0755abbd None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.668602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88051bcc-1b8c-4c89-ac5e-203a008cb66a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.701001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc5820-250d-45b7-8e0c-e11acbca7887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.701431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde8218-090d-4a4b-afcc-429e4a38b2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.701798 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc5820-250d-45b7-8e0c-e11acbca7887 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.702075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc5820-250d-45b7-8e0c-e11acbca7887 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.702257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde8218-090d-4a4b-afcc-429e4a38b2d1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.702358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc5820-250d-45b7-8e0c-e11acbca7887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.702538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde8218-090d-4a4b-afcc-429e4a38b2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.702811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde8218-090d-4a4b-afcc-429e4a38b2d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.711981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc5820-250d-45b7-8e0c-e11acbca7887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.712365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde8218-090d-4a4b-afcc-429e4a38b2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.713454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc5820-250d-45b7-8e0c-e11acbca7887 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.713834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde8218-090d-4a4b-afcc-429e4a38b2d1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.730448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-8bbc5820-250d-45b7-8e0c-e11acbca7887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:36.730617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-ddde8218-090d-4a4b-afcc-429e4a38b2d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:36.731937 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 545/1077] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:36.732058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 533/1078] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:36.732310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc5820-250d-45b7-8e0c-e11acbca7887 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.737607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde8218-090d-4a4b-afcc-429e4a38b2d1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.830941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc5820-250d-45b7-8e0c-e11acbca7887 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.832657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde8218-090d-4a4b-afcc-429e4a38b2d1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:36.864550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b030f6-606f-44fd-b6ff-499496e97f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.865546 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b030f6-606f-44fd-b6ff-499496e97f68 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.865767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae043e-df0e-4a90-b862-bef97d7510bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:36.865926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b030f6-606f-44fd-b6ff-499496e97f68 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.866295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b030f6-606f-44fd-b6ff-499496e97f68 None admin] PATH_INFO: `/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d/users/2743bbeafb184d6ab33c67356ebb35de/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.866445 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae043e-df0e-4a90-b862-bef97d7510bd None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:36.866708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae043e-df0e-4a90-b862-bef97d7510bd None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:36.866982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae043e-df0e-4a90-b862-bef97d7510bd None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:36.867706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae043e-df0e-4a90-b862-bef97d7510bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:36.868003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae043e-df0e-4a90-b862-bef97d7510bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.868364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b030f6-606f-44fd-b6ff-499496e97f68 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e10e5a1130b462cb812ba3ee2875d5d, user_id=2743bbeafb184d6ab33c67356ebb35de, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:36.869372 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae043e-df0e-4a90-b862-bef97d7510bd None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.869850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b030f6-606f-44fd-b6ff-499496e97f68 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:36.881164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 534/1079] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:36.881967 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae043e-df0e-4a90-b862-bef97d7510bd None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.884713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 546/1080] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:40:36 2022] PUT /identity/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d/users/2743bbeafb184d6ab33c67356ebb35de/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:40:36.886899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b030f6-606f-44fd-b6ff-499496e97f68 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:36.988874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae043e-df0e-4a90-b862-bef97d7510bd None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:37.000008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b030f6-606f-44fd-b6ff-499496e97f68 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:37.023953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4608ea-0a2d-4bc9-ab11-3bea9ec43395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:37.024954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4608ea-0a2d-4bc9-ab11-3bea9ec43395 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:37.025316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4608ea-0a2d-4bc9-ab11-3bea9ec43395 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:37.025586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4608ea-0a2d-4bc9-ab11-3bea9ec43395 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:37.026287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4608ea-0a2d-4bc9-ab11-3bea9ec43395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:37.026599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4608ea-0a2d-4bc9-ab11-3bea9ec43395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:37.028183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4608ea-0a2d-4bc9-ab11-3bea9ec43395 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:37.035661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ea7b-ec82-4b64-9d2c-84a05eb519ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:37.036489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ea7b-ec82-4b64-9d2c-84a05eb519ee None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:37.036770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ea7b-ec82-4b64-9d2c-84a05eb519ee None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:37.037046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ea7b-ec82-4b64-9d2c-84a05eb519ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:37.050352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 535/1081] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:37.050577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834ea7b-ec82-4b64-9d2c-84a05eb519ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:37.050577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834ea7b-ec82-4b64-9d2c-84a05eb519ee None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:37.061377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-e834ea7b-ec82-4b64-9d2c-84a05eb519ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:37.062904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 547/1082] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:37.069031 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4608ea-0a2d-4bc9-ab11-3bea9ec43395 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:37.174359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4608ea-0a2d-4bc9-ab11-3bea9ec43395 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:37.211167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2608ff0-525d-4063-bf1b-11ae60ad04bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:37.211856 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608ff0-525d-4063-bf1b-11ae60ad04bd None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:37.212130 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608ff0-525d-4063-bf1b-11ae60ad04bd None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:37.212408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608ff0-525d-4063-bf1b-11ae60ad04bd None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:37.213196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2608ff0-525d-4063-bf1b-11ae60ad04bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:37.213501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2608ff0-525d-4063-bf1b-11ae60ad04bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:37.214995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2608ff0-525d-4063-bf1b-11ae60ad04bd None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:37.228862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 536/1083] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:37.234169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ea7b-ec82-4b64-9d2c-84a05eb519ee None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:37.336914 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ea7b-ec82-4b64-9d2c-84a05eb519ee None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:37.368402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b408a-7176-4852-b81a-6704945b2caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:37.369294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b408a-7176-4852-b81a-6704945b2caa None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:37.369570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b408a-7176-4852-b81a-6704945b2caa None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:37.369843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b408a-7176-4852-b81a-6704945b2caa None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/be7be85d70b64273b7904082ee2ba848/roles/5d9f5b21f518437b9d6a33ac52315fb6` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:37.372022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b408a-7176-4852-b81a-6704945b2caa None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=be7be85d70b64273b7904082ee2ba848, role_id=5d9f5b21f518437b9d6a33ac52315fb6)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:37.373463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b408a-7176-4852-b81a-6704945b2caa None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:37.386132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 548/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:40:37 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/be7be85d70b64273b7904082ee2ba848/roles/5d9f5b21f518437b9d6a33ac52315fb6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:40:39.189137 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae9ead-1d66-4c78-a72c-3f42ac06eec2 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:39.189717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae9ead-1d66-4c78-a72c-3f42ac06eec2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:39.189717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae9ead-1d66-4c78-a72c-3f42ac06eec2 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:39.191465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 537/1085] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:39.197149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccae671-fbb0-4525-ac48-477050b39ecd None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:39.197559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccae671-fbb0-4525-ac48-477050b39ecd None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:39.197738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccae671-fbb0-4525-ac48-477050b39ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:39.215089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2ccae671-fbb0-4525-ac48-477050b39ecd None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:39.216320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2ccae671-fbb0-4525-ac48-477050b39ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:39.282472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 549/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:39.307162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae9ead-1d66-4c78-a72c-3f42ac06eec2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:39.411944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae9ead-1d66-4c78-a72c-3f42ac06eec2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:39.446056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759028a4-1fd8-4459-981b-6cf6cee5334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:39.446815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759028a4-1fd8-4459-981b-6cf6cee5334c None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:39.447093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759028a4-1fd8-4459-981b-6cf6cee5334c None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:39.447360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759028a4-1fd8-4459-981b-6cf6cee5334c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:39.457298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759028a4-1fd8-4459-981b-6cf6cee5334c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:39.464223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-759028a4-1fd8-4459-981b-6cf6cee5334c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:40:39.465444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 538/1087] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:40:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:39.471883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccae671-fbb0-4525-ac48-477050b39ecd None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:39.569418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccae671-fbb0-4525-ac48-477050b39ecd None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:39.601826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0daac-b3dc-46f9-9fc6-c8b01fb7bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:39.602636 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0daac-b3dc-46f9-9fc6-c8b01fb7bede None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:39.602920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0daac-b3dc-46f9-9fc6-c8b01fb7bede None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:39.603194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0daac-b3dc-46f9-9fc6-c8b01fb7bede None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:39.603949 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0daac-b3dc-46f9-9fc6-c8b01fb7bede None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:39.604261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0daac-b3dc-46f9-9fc6-c8b01fb7bede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:39.605770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0daac-b3dc-46f9-9fc6-c8b01fb7bede None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:39.614183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 550/1088] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:40:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:39.620212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759028a4-1fd8-4459-981b-6cf6cee5334c None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:39.678907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4906-1600-494a-80cc-6c4ca92a947a None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:39.679149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4906-1600-494a-80cc-6c4ca92a947a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:39.679460 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4906-1600-494a-80cc-6c4ca92a947a None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:39.681228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 551/1089] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:40:39.686123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b1ae4-aa69-458d-8a16-a9ff9f090332 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:39.686431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b1ae4-aa69-458d-8a16-a9ff9f090332 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:39.686710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b1ae4-aa69-458d-8a16-a9ff9f090332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:39.703414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-c11b1ae4-aa69-458d-8a16-a9ff9f090332 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:39.704527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c11b1ae4-aa69-458d-8a16-a9ff9f090332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:39.722715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759028a4-1fd8-4459-981b-6cf6cee5334c None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:39.754181 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d9970-fe66-435e-9dbc-869037fa175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:39.755053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9970-fe66-435e-9dbc-869037fa175f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:39.755326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9970-fe66-435e-9dbc-869037fa175f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:39.755592 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9970-fe66-435e-9dbc-869037fa175f None admin] PATH_INFO: `/v3/users/2743bbeafb184d6ab33c67356ebb35de` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:39.756758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d9970-fe66-435e-9dbc-869037fa175f None admin] RBAC: Authorizing `identity:get_user(user_id=2743bbeafb184d6ab33c67356ebb35de)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:39.758223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d9970-fe66-435e-9dbc-869037fa175f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:39.760018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 539/1090] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:40:39 2022] GET /identity/v3/users/2743bbeafb184d6ab33c67356ebb35de => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:39.765620 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d9970-fe66-435e-9dbc-869037fa175f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:39.769476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 552/1091] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:40:39.793279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b1ae4-aa69-458d-8a16-a9ff9f090332 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:39.859800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d9970-fe66-435e-9dbc-869037fa175f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:39.887318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b1ae4-aa69-458d-8a16-a9ff9f090332 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:39.894797 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c693d81-fb69-43d7-9719-c2111a4a58e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:39.895443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c693d81-fb69-43d7-9719-c2111a4a58e6 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:39.895716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c693d81-fb69-43d7-9719-c2111a4a58e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:39.895983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c693d81-fb69-43d7-9719-c2111a4a58e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:39.919009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82748cc-3c36-47ae-a88a-6dfba67c9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:39.919829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82748cc-3c36-47ae-a88a-6dfba67c9fa0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:39.920103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82748cc-3c36-47ae-a88a-6dfba67c9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:39.920363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82748cc-3c36-47ae-a88a-6dfba67c9fa0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:39.929986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82748cc-3c36-47ae-a88a-6dfba67c9fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:40:39.937436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-d82748cc-3c36-47ae-a88a-6dfba67c9fa0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:40:39.938664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 553/1092] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Oct 28 19:40:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:40:39.944597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82748cc-3c36-47ae-a88a-6dfba67c9fa0 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:39.959202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c693d81-fb69-43d7-9719-c2111a4a58e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:39.960592 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c693d81-fb69-43d7-9719-c2111a4a58e6 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:40.038990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82748cc-3c36-47ae-a88a-6dfba67c9fa0 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:40.052964 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 540/1093] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 19:40:40.059008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c693d81-fb69-43d7-9719-c2111a4a58e6 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:40.071368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b251f3-5700-47e7-bdc7-ecc06fc4600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:40.072033 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b251f3-5700-47e7-bdc7-ecc06fc4600c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:40.072306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b251f3-5700-47e7-bdc7-ecc06fc4600c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:40.072572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b251f3-5700-47e7-bdc7-ecc06fc4600c None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:40.073311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b251f3-5700-47e7-bdc7-ecc06fc4600c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:40.073608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b251f3-5700-47e7-bdc7-ecc06fc4600c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:40.075032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b251f3-5700-47e7-bdc7-ecc06fc4600c None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:40.082795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 554/1094] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Oct 28 19:40:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:40.088482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b251f3-5700-47e7-bdc7-ecc06fc4600c None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:40.151674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c693d81-fb69-43d7-9719-c2111a4a58e6 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:40.185344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b251f3-5700-47e7-bdc7-ecc06fc4600c None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:40.186244 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db929ff2-1a38-4376-ace9-868e97f33802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:40.187112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db929ff2-1a38-4376-ace9-868e97f33802 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:40.187395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db929ff2-1a38-4376-ace9-868e97f33802 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:40.187669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db929ff2-1a38-4376-ace9-868e97f33802 None admin] PATH_INFO: `/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:40.188855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db929ff2-1a38-4376-ace9-868e97f33802 None admin] RBAC: Authorizing `identity:get_project(project_id=5e10e5a1130b462cb812ba3ee2875d5d)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:40.190337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db929ff2-1a38-4376-ace9-868e97f33802 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:40.197044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 541/1095] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:40:40 2022] GET /identity/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:40.198009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db929ff2-1a38-4376-ace9-868e97f33802 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:40.218644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f413de0-f69d-419c-8dab-15f6bf5472d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:40.219388 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f413de0-f69d-419c-8dab-15f6bf5472d0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:40.219667 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f413de0-f69d-419c-8dab-15f6bf5472d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:40.219933 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f413de0-f69d-419c-8dab-15f6bf5472d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:40.230712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f413de0-f69d-419c-8dab-15f6bf5472d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:40.232160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f413de0-f69d-419c-8dab-15f6bf5472d0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:40.248621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-9f413de0-f69d-419c-8dab-15f6bf5472d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:40.249806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 555/1096] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:40.255717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f413de0-f69d-419c-8dab-15f6bf5472d0 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:40.293019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db929ff2-1a38-4376-ace9-868e97f33802 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:40.325149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d66e90-946e-4650-ab84-e1782a682336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:40.325799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d66e90-946e-4650-ab84-e1782a682336 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:40.326112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d66e90-946e-4650-ab84-e1782a682336 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:40.326385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d66e90-946e-4650-ab84-e1782a682336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:40.327182 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d66e90-946e-4650-ab84-e1782a682336 None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=5e10e5a1130b462cb812ba3ee2875d5d, user.id=2743bbeafb184d6ab33c67356ebb35de) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:40.327494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d66e90-946e-4650-ab84-e1782a682336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:40.328916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d66e90-946e-4650-ab84-e1782a682336 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:40.334679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 542/1097] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:40 2022] GET /identity/v3/role_assignments?user.id=2743bbeafb184d6ab33c67356ebb35de&scope.project.id=5e10e5a1130b462cb812ba3ee2875d5d&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:40.352651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f413de0-f69d-419c-8dab-15f6bf5472d0 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:40.389266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aba59-be78-473a-824b-baab1bf14526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:40.389960 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aba59-be78-473a-824b-baab1bf14526 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:40.390293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aba59-be78-473a-824b-baab1bf14526 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:40.390567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aba59-be78-473a-824b-baab1bf14526 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:40.391312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aba59-be78-473a-824b-baab1bf14526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:40.391687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aba59-be78-473a-824b-baab1bf14526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:40.393118 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aba59-be78-473a-824b-baab1bf14526 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:40.406600 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 556/1098] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:40.412604 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d66e90-946e-4650-ab84-e1782a682336 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:40.515760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d66e90-946e-4650-ab84-e1782a682336 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:40.552469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d080da-cf54-45b9-8314-4b016eb8f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:40.553276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d080da-cf54-45b9-8314-4b016eb8f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:40.553553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d080da-cf54-45b9-8314-4b016eb8f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:40.553816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d080da-cf54-45b9-8314-4b016eb8f5a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:40.561896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d080da-cf54-45b9-8314-4b016eb8f5a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:40.563381 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d080da-cf54-45b9-8314-4b016eb8f5a7 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:40.577016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-04d080da-cf54-45b9-8314-4b016eb8f5a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:40:40.578229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 543/1099] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Oct 28 19:40:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:40.584128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aba59-be78-473a-824b-baab1bf14526 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:40.684179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aba59-be78-473a-824b-baab1bf14526 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:40.718105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc5d7-ef1b-439d-9cbe-399863cd3856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:40.718807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc5d7-ef1b-439d-9cbe-399863cd3856 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:40.719089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc5d7-ef1b-439d-9cbe-399863cd3856 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:40.719385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc5d7-ef1b-439d-9cbe-399863cd3856 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:40.720211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc5d7-ef1b-439d-9cbe-399863cd3856 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:40.720517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc5d7-ef1b-439d-9cbe-399863cd3856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:40.721952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc5d7-ef1b-439d-9cbe-399863cd3856 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:40.738754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 557/1100] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Oct 28 19:40:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:40.744650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d080da-cf54-45b9-8314-4b016eb8f5a7 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:40.847489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d080da-cf54-45b9-8314-4b016eb8f5a7 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:40.881566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea906350-181e-4013-9d15-ec67027289b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:40.882256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea906350-181e-4013-9d15-ec67027289b7 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:40.882535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea906350-181e-4013-9d15-ec67027289b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:40.882808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea906350-181e-4013-9d15-ec67027289b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:40.947158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea906350-181e-4013-9d15-ec67027289b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:40.948595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea906350-181e-4013-9d15-ec67027289b7 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:41.046209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 544/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:41.052202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc5d7-ef1b-439d-9cbe-399863cd3856 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:41.150345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc5d7-ef1b-439d-9cbe-399863cd3856 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:41.184200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1063e-4e3a-4fb2-8a59-6ac365653978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:41.185004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1063e-4e3a-4fb2-8a59-6ac365653978 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:41.185284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1063e-4e3a-4fb2-8a59-6ac365653978 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:41.185552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1063e-4e3a-4fb2-8a59-6ac365653978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:41.195662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1063e-4e3a-4fb2-8a59-6ac365653978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:41.197122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1063e-4e3a-4fb2-8a59-6ac365653978 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:41.213898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-0bd1063e-4e3a-4fb2-8a59-6ac365653978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:40:41.215409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 558/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:41.221132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea906350-181e-4013-9d15-ec67027289b7 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:41.321718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea906350-181e-4013-9d15-ec67027289b7 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:41.354982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ad05f-b4a0-4bb6-aa1d-e12739fed606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:41.355670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ad05f-b4a0-4bb6-aa1d-e12739fed606 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:41.355951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ad05f-b4a0-4bb6-aa1d-e12739fed606 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:41.356220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ad05f-b4a0-4bb6-aa1d-e12739fed606 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:41.356932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ad05f-b4a0-4bb6-aa1d-e12739fed606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:41.357236 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ad05f-b4a0-4bb6-aa1d-e12739fed606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:41.358632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ad05f-b4a0-4bb6-aa1d-e12739fed606 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:41.370791 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 545/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:41.376719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1063e-4e3a-4fb2-8a59-6ac365653978 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:41.475652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1063e-4e3a-4fb2-8a59-6ac365653978 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:41.511127 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb01da-53d4-4de2-83df-cbb97f28bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:41.511985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb01da-53d4-4de2-83df-cbb97f28bf31 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:41.512255 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb01da-53d4-4de2-83df-cbb97f28bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:41.512523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb01da-53d4-4de2-83df-cbb97f28bf31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:41.519269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb01da-53d4-4de2-83df-cbb97f28bf31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:41.520721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb01da-53d4-4de2-83df-cbb97f28bf31 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:41.533494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-9bcb01da-53d4-4de2-83df-cbb97f28bf31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:40:41.534698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 559/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:40:41.540795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ad05f-b4a0-4bb6-aa1d-e12739fed606 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:41.641924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ad05f-b4a0-4bb6-aa1d-e12739fed606 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:41.680097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a14764-9a83-417e-b3a9-f5266498ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:41.680765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14764-9a83-417e-b3a9-f5266498ade9 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:41.681050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14764-9a83-417e-b3a9-f5266498ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:41.681320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14764-9a83-417e-b3a9-f5266498ade9 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:41.682120 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a14764-9a83-417e-b3a9-f5266498ade9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:41.682430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a14764-9a83-417e-b3a9-f5266498ade9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:41.683861 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a14764-9a83-417e-b3a9-f5266498ade9 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:41.695281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 546/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:41.701635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb01da-53d4-4de2-83df-cbb97f28bf31 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:41.802882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb01da-53d4-4de2-83df-cbb97f28bf31 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:41.836361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91caea-87f6-45d8-bb1d-f75a0c34a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:41.837013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91caea-87f6-45d8-bb1d-f75a0c34a6bc None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:41.837290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91caea-87f6-45d8-bb1d-f75a0c34a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:41.837564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91caea-87f6-45d8-bb1d-f75a0c34a6bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:41.838432 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91caea-87f6-45d8-bb1d-f75a0c34a6bc None admin] RBAC: Adding query filter params (role.id=5d9f5b21f518437b9d6a33ac52315fb6, scope.project.id=e91226b635934bfcb949577491791af4, user.id=be7be85d70b64273b7904082ee2ba848) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:41.838744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91caea-87f6-45d8-bb1d-f75a0c34a6bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:41.840201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91caea-87f6-45d8-bb1d-f75a0c34a6bc None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:41.846128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 560/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:41 2022] GET /identity/v3/role_assignments?user.id=be7be85d70b64273b7904082ee2ba848&scope.project.id=e91226b635934bfcb949577491791af4&role.id=5d9f5b21f518437b9d6a33ac52315fb6 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:42.692956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837906f6-1274-4616-aa08-5492bbaa8f3b None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:42.693493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837906f6-1274-4616-aa08-5492bbaa8f3b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:42.693493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837906f6-1274-4616-aa08-5492bbaa8f3b None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:42.695342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 547/1107] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:42.700984 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b3440-a6fb-4b40-880c-19f9e475b65c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:42.701457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b3440-a6fb-4b40-880c-19f9e475b65c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:42.701544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b3440-a6fb-4b40-880c-19f9e475b65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:42.720130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-937b3440-a6fb-4b40-880c-19f9e475b65c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:42.721309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-937b3440-a6fb-4b40-880c-19f9e475b65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:42.789514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 561/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:42.816993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837906f6-1274-4616-aa08-5492bbaa8f3b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:42.932433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837906f6-1274-4616-aa08-5492bbaa8f3b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:42.966134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f261dc-c248-406b-9043-4d0233cac6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:42.966942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f261dc-c248-406b-9043-4d0233cac6c7 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:42.967219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f261dc-c248-406b-9043-4d0233cac6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:42.967487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f261dc-c248-406b-9043-4d0233cac6c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:42.968772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f261dc-c248-406b-9043-4d0233cac6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:42.970199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f261dc-c248-406b-9043-4d0233cac6c7 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:42.971816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 548/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:42.978026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b3440-a6fb-4b40-880c-19f9e475b65c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:43.079463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b3440-a6fb-4b40-880c-19f9e475b65c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:43.114746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e9bad-e6bc-4add-9d2b-2909452f55c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:43.115407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9bad-e6bc-4add-9d2b-2909452f55c7 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:43.115679 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9bad-e6bc-4add-9d2b-2909452f55c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:43.115951 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9bad-e6bc-4add-9d2b-2909452f55c7 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:43.116666 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e9bad-e6bc-4add-9d2b-2909452f55c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:43.118109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e9bad-e6bc-4add-9d2b-2909452f55c7 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:43.140002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 562/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:40:42 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:45.484934 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f6f9-aa47-4f8c-83f7-213dc8875ef5 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:45.485801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f6f9-aa47-4f8c-83f7-213dc8875ef5 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:45.485801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f6f9-aa47-4f8c-83f7-213dc8875ef5 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:45.488732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 549/1111] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:45.495191 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22139e3-4ea7-4984-b3f8-1e9116371182 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:45.495667 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22139e3-4ea7-4984-b3f8-1e9116371182 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:45.495760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22139e3-4ea7-4984-b3f8-1e9116371182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:45.519317 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b22139e3-4ea7-4984-b3f8-1e9116371182 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:45.520506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b22139e3-4ea7-4984-b3f8-1e9116371182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:45.588231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 563/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:45.617801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838f6f9-aa47-4f8c-83f7-213dc8875ef5 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:45.723220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838f6f9-aa47-4f8c-83f7-213dc8875ef5 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:45.768829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee396d59-078b-4f30-882c-9f285d61305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:45.769686 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee396d59-078b-4f30-882c-9f285d61305b None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:45.769963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee396d59-078b-4f30-882c-9f285d61305b None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:45.770266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee396d59-078b-4f30-882c-9f285d61305b None admin] PATH_INFO: `/v3/roles/23f476d154c04684802479843819b199` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:45.771850 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee396d59-078b-4f30-882c-9f285d61305b None admin] RBAC: Authorizing `identity:get_role(role_id=23f476d154c04684802479843819b199)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:45.773224 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee396d59-078b-4f30-882c-9f285d61305b None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:45.774613 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 550/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:40:45 2022] GET /identity/v3/roles/23f476d154c04684802479843819b199 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:45.782751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22139e3-4ea7-4984-b3f8-1e9116371182 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:45.895711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22139e3-4ea7-4984-b3f8-1e9116371182 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:45.931800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e0af6-0bb5-4781-a226-6fcd35c1c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:45.933158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e0af6-0bb5-4781-a226-6fcd35c1c48d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:45.933435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e0af6-0bb5-4781-a226-6fcd35c1c48d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:45.933701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e0af6-0bb5-4781-a226-6fcd35c1c48d None admin] PATH_INFO: `/v3/users/71ff192635e94e26a794a7ad3d306f4b` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:45.948697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e0af6-0bb5-4781-a226-6fcd35c1c48d None admin] RBAC: Authorizing `identity:get_user(user_id=71ff192635e94e26a794a7ad3d306f4b)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:45.950179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e0af6-0bb5-4781-a226-6fcd35c1c48d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:45.951804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 564/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:40:45 2022] GET /identity/v3/users/71ff192635e94e26a794a7ad3d306f4b => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:45.958215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee396d59-078b-4f30-882c-9f285d61305b None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:46.072422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee396d59-078b-4f30-882c-9f285d61305b None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:46.105639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acac884-5cfc-4655-a530-35039812f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:46.106308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac884-5cfc-4655-a530-35039812f618 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:46.106586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac884-5cfc-4655-a530-35039812f618 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:46.106865 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac884-5cfc-4655-a530-35039812f618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:46.169713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acac884-5cfc-4655-a530-35039812f618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:46.171199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acac884-5cfc-4655-a530-35039812f618 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:46.262630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 551/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:46.271754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e0af6-0bb5-4781-a226-6fcd35c1c48d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:46.506466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e0af6-0bb5-4781-a226-6fcd35c1c48d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:46.540272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02426fe0-4d6b-479d-a1cf-a7993079dcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:46.541112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02426fe0-4d6b-479d-a1cf-a7993079dcdd None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:46.541389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02426fe0-4d6b-479d-a1cf-a7993079dcdd None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:46.541654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02426fe0-4d6b-479d-a1cf-a7993079dcdd None admin] PATH_INFO: `/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:46.543445 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02426fe0-4d6b-479d-a1cf-a7993079dcdd None admin] RBAC: Authorizing `identity:get_project(project_id=5e10e5a1130b462cb812ba3ee2875d5d)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:46.544862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02426fe0-4d6b-479d-a1cf-a7993079dcdd None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:46.546592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 565/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:40:46 2022] GET /identity/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d => generated 311 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:46.553312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acac884-5cfc-4655-a530-35039812f618 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:46.655207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acac884-5cfc-4655-a530-35039812f618 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:46.689470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e6b01-875a-4d6c-8d40-565dd83eaa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:46.690140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6b01-875a-4d6c-8d40-565dd83eaa60 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:46.690424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6b01-875a-4d6c-8d40-565dd83eaa60 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:46.690703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6b01-875a-4d6c-8d40-565dd83eaa60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:46.691521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e6b01-875a-4d6c-8d40-565dd83eaa60 None admin] RBAC: Adding query filter params (role.id=23f476d154c04684802479843819b199, scope.project.id=5e10e5a1130b462cb812ba3ee2875d5d, user.id=71ff192635e94e26a794a7ad3d306f4b) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:46.691828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e6b01-875a-4d6c-8d40-565dd83eaa60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:46.693269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e6b01-875a-4d6c-8d40-565dd83eaa60 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:46.698754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 552/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:46 2022] GET /identity/v3/role_assignments?user.id=71ff192635e94e26a794a7ad3d306f4b&scope.project.id=5e10e5a1130b462cb812ba3ee2875d5d&role.id=23f476d154c04684802479843819b199 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:48.961054 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075a784-87fb-4e7e-adaa-b38ea955daf0 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:48.961857 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075a784-87fb-4e7e-adaa-b38ea955daf0 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:48.961857 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075a784-87fb-4e7e-adaa-b38ea955daf0 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:48.964491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 566/1118] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:48.971079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df5980-7d71-4b3f-8334-f035f2be066a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:48.971505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df5980-7d71-4b3f-8334-f035f2be066a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:48.971730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df5980-7d71-4b3f-8334-f035f2be066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:48.997398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-62df5980-7d71-4b3f-8334-f035f2be066a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:48.998615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-62df5980-7d71-4b3f-8334-f035f2be066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:49.069785 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 553/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:49.100602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075a784-87fb-4e7e-adaa-b38ea955daf0 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:49.205431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075a784-87fb-4e7e-adaa-b38ea955daf0 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:49.239399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d13be6-fda5-4c6d-b0d4-dc449ef53c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:49.240247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d13be6-fda5-4c6d-b0d4-dc449ef53c12 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:49.240526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d13be6-fda5-4c6d-b0d4-dc449ef53c12 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:49.240793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d13be6-fda5-4c6d-b0d4-dc449ef53c12 None admin] PATH_INFO: `/v3/roles/23f476d154c04684802479843819b199` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:49.242406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d13be6-fda5-4c6d-b0d4-dc449ef53c12 None admin] RBAC: Authorizing `identity:get_role(role_id=23f476d154c04684802479843819b199)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:49.243781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d13be6-fda5-4c6d-b0d4-dc449ef53c12 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:49.245346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 567/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:40:49 2022] GET /identity/v3/roles/23f476d154c04684802479843819b199 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:49.253842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df5980-7d71-4b3f-8334-f035f2be066a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:49.353533 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df5980-7d71-4b3f-8334-f035f2be066a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:49.387229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98189-e098-4f0b-9341-84bb478c3c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:49.388091 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98189-e098-4f0b-9341-84bb478c3c16 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:49.388368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98189-e098-4f0b-9341-84bb478c3c16 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:49.388633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98189-e098-4f0b-9341-84bb478c3c16 None admin] PATH_INFO: `/v3/users/71ff192635e94e26a794a7ad3d306f4b` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:49.389938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98189-e098-4f0b-9341-84bb478c3c16 None admin] RBAC: Authorizing `identity:get_user(user_id=71ff192635e94e26a794a7ad3d306f4b)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:49.391402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98189-e098-4f0b-9341-84bb478c3c16 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:49.393001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 554/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:40:49 2022] GET /identity/v3/users/71ff192635e94e26a794a7ad3d306f4b => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:49.401805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d13be6-fda5-4c6d-b0d4-dc449ef53c12 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:49.499767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d13be6-fda5-4c6d-b0d4-dc449ef53c12 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:49.533235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b0184-76e5-4dbf-ae85-b9f019ec2251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:49.534102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b0184-76e5-4dbf-ae85-b9f019ec2251 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:49.534394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b0184-76e5-4dbf-ae85-b9f019ec2251 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:49.534661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b0184-76e5-4dbf-ae85-b9f019ec2251 None admin] PATH_INFO: `/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:49.535930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b0184-76e5-4dbf-ae85-b9f019ec2251 None admin] RBAC: Authorizing `identity:get_project(project_id=5e10e5a1130b462cb812ba3ee2875d5d)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:49.537359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b0184-76e5-4dbf-ae85-b9f019ec2251 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:49.539038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 568/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:40:49 2022] GET /identity/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:49.545781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98189-e098-4f0b-9341-84bb478c3c16 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:49.644539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98189-e098-4f0b-9341-84bb478c3c16 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:49.682219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bbfdf-d383-4666-85dd-0e1b91671290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:49.683162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bbfdf-d383-4666-85dd-0e1b91671290 None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:49.683440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bbfdf-d383-4666-85dd-0e1b91671290 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:49.683712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bbfdf-d383-4666-85dd-0e1b91671290 None admin] PATH_INFO: `/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d/users/71ff192635e94e26a794a7ad3d306f4b/roles/23f476d154c04684802479843819b199` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:49.686003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bbfdf-d383-4666-85dd-0e1b91671290 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e10e5a1130b462cb812ba3ee2875d5d, user_id=71ff192635e94e26a794a7ad3d306f4b, role_id=23f476d154c04684802479843819b199)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:49.687478 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bbfdf-d383-4666-85dd-0e1b91671290 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:49.703808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 555/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:40:49 2022] PUT /identity/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d/users/71ff192635e94e26a794a7ad3d306f4b/roles/23f476d154c04684802479843819b199 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:40:51.970695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac682e-27b7-4db4-a672-872e9151b565 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:51.971222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac682e-27b7-4db4-a672-872e9151b565 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:51.971222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac682e-27b7-4db4-a672-872e9151b565 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:51.973902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 569/1124] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:51.980482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fa562-4be6-43f7-b990-d3354c7349f6 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:51.980887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fa562-4be6-43f7-b990-d3354c7349f6 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:51.981070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fa562-4be6-43f7-b990-d3354c7349f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:52.003999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e50fa562-4be6-43f7-b990-d3354c7349f6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:52.005184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e50fa562-4be6-43f7-b990-d3354c7349f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:52.072458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 556/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:52.096823 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac682e-27b7-4db4-a672-872e9151b565 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:52.208088 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac682e-27b7-4db4-a672-872e9151b565 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:52.241507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c378847-9e5c-4fd5-b377-8e1699245139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:52.242373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c378847-9e5c-4fd5-b377-8e1699245139 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:52.242650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c378847-9e5c-4fd5-b377-8e1699245139 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:52.242913 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c378847-9e5c-4fd5-b377-8e1699245139 None admin] PATH_INFO: `/v3/roles/23f476d154c04684802479843819b199` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:52.244478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c378847-9e5c-4fd5-b377-8e1699245139 None admin] RBAC: Authorizing `identity:get_role(role_id=23f476d154c04684802479843819b199)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:52.245872 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c378847-9e5c-4fd5-b377-8e1699245139 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:52.247249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 570/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:40:52 2022] GET /identity/v3/roles/23f476d154c04684802479843819b199 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:52.256032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fa562-4be6-43f7-b990-d3354c7349f6 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:52.352525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fa562-4be6-43f7-b990-d3354c7349f6 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:52.385653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd86780-e532-4aaf-9a44-21e27336f3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:52.386545 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86780-e532-4aaf-9a44-21e27336f3fc None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:52.386831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86780-e532-4aaf-9a44-21e27336f3fc None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:52.387144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86780-e532-4aaf-9a44-21e27336f3fc None admin] PATH_INFO: `/v3/users/71ff192635e94e26a794a7ad3d306f4b` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:52.388312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd86780-e532-4aaf-9a44-21e27336f3fc None admin] RBAC: Authorizing `identity:get_user(user_id=71ff192635e94e26a794a7ad3d306f4b)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:52.389729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd86780-e532-4aaf-9a44-21e27336f3fc None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:52.391357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 557/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:40:52 2022] GET /identity/v3/users/71ff192635e94e26a794a7ad3d306f4b => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:52.399805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c378847-9e5c-4fd5-b377-8e1699245139 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:52.508397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c378847-9e5c-4fd5-b377-8e1699245139 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:52.543689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11705f01-328d-4877-a4d1-92111fc75a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:52.544326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11705f01-328d-4877-a4d1-92111fc75a66 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:52.544601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11705f01-328d-4877-a4d1-92111fc75a66 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:52.544870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11705f01-328d-4877-a4d1-92111fc75a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:52.611303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11705f01-328d-4877-a4d1-92111fc75a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:52.612747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11705f01-328d-4877-a4d1-92111fc75a66 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:52.717348 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 571/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:40:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:40:52.723703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd86780-e532-4aaf-9a44-21e27336f3fc None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:52.827743 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd86780-e532-4aaf-9a44-21e27336f3fc None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:52.864976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e9921-5dc3-4a82-95e6-0eeba0d2b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:52.865834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9921-5dc3-4a82-95e6-0eeba0d2b198 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:52.866131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9921-5dc3-4a82-95e6-0eeba0d2b198 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:52.866406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9921-5dc3-4a82-95e6-0eeba0d2b198 None admin] PATH_INFO: `/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:52.867713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e9921-5dc3-4a82-95e6-0eeba0d2b198 None admin] RBAC: Authorizing `identity:get_project(project_id=5e10e5a1130b462cb812ba3ee2875d5d)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:52.869152 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e9921-5dc3-4a82-95e6-0eeba0d2b198 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:52.871030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 558/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:40:52 2022] GET /identity/v3/projects/5e10e5a1130b462cb812ba3ee2875d5d => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:40:52.878138 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11705f01-328d-4877-a4d1-92111fc75a66 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:52.989557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11705f01-328d-4877-a4d1-92111fc75a66 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:53.024199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38729ef1-7d6a-4f34-ad44-d80fc902e4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:53.024850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38729ef1-7d6a-4f34-ad44-d80fc902e4c3 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:53.025128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38729ef1-7d6a-4f34-ad44-d80fc902e4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:53.025393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38729ef1-7d6a-4f34-ad44-d80fc902e4c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:53.026260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38729ef1-7d6a-4f34-ad44-d80fc902e4c3 None admin] RBAC: Adding query filter params (role.id=23f476d154c04684802479843819b199, scope.project.id=5e10e5a1130b462cb812ba3ee2875d5d, user.id=71ff192635e94e26a794a7ad3d306f4b) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:40:53.026570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38729ef1-7d6a-4f34-ad44-d80fc902e4c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:53.028005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38729ef1-7d6a-4f34-ad44-d80fc902e4c3 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:53.033852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 572/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:40:52 2022] GET /identity/v3/role_assignments?user.id=71ff192635e94e26a794a7ad3d306f4b&scope.project.id=5e10e5a1130b462cb812ba3ee2875d5d&role.id=23f476d154c04684802479843819b199 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:55.330948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110cfa-a2b0-4b38-9701-488d46f7e9a1 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:55.331509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110cfa-a2b0-4b38-9701-488d46f7e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:55.331509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110cfa-a2b0-4b38-9701-488d46f7e9a1 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:55.333262 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 559/1131] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:55.339824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9f40e-9c16-45f1-811b-4ef2c78afe2f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:55.340520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9f40e-9c16-45f1-811b-4ef2c78afe2f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:55.340672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9f40e-9c16-45f1-811b-4ef2c78afe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:55.363156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-99f9f40e-9c16-45f1-811b-4ef2c78afe2f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:55.364339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-99f9f40e-9c16-45f1-811b-4ef2c78afe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:55.432429 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 573/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:55.462069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110cfa-a2b0-4b38-9701-488d46f7e9a1 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:55.571919 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110cfa-a2b0-4b38-9701-488d46f7e9a1 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:55.607812 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94681154-c6e1-45a3-82fe-704aa5a852ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:55.609001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94681154-c6e1-45a3-82fe-704aa5a852ac None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:55.609412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94681154-c6e1-45a3-82fe-704aa5a852ac None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:55.609815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94681154-c6e1-45a3-82fe-704aa5a852ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:55.611905 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94681154-c6e1-45a3-82fe-704aa5a852ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:55.614145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94681154-c6e1-45a3-82fe-704aa5a852ac None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:55.616617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 560/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:55.623695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9f40e-9c16-45f1-811b-4ef2c78afe2f None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:55.724464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9f40e-9c16-45f1-811b-4ef2c78afe2f None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:55.761196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeca03-d6f3-4346-a256-b0f99306289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:55.761836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeca03-d6f3-4346-a256-b0f99306289b None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:55.762118 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeca03-d6f3-4346-a256-b0f99306289b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:55.762406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeca03-d6f3-4346-a256-b0f99306289b None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:55.763113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baeca03-d6f3-4346-a256-b0f99306289b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:55.764559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baeca03-d6f3-4346-a256-b0f99306289b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:55.798590 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 574/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:40:55 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:40:58.115010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e050e-e056-4afd-b63f-8db375af1ac8 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:58.115912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e050e-e056-4afd-b63f-8db375af1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:58.115912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e050e-e056-4afd-b63f-8db375af1ac8 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:58.118768 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 561/1135] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:40:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:40:58.125029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a94f91-9269-45f7-91df-0a87bd188909 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:58.125465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a94f91-9269-45f7-91df-0a87bd188909 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:58.125605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a94f91-9269-45f7-91df-0a87bd188909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:58.146638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-c1a94f91-9269-45f7-91df-0a87bd188909 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:40:58.147810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c1a94f91-9269-45f7-91df-0a87bd188909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:40:58.219156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 575/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:40:58.244751 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e050e-e056-4afd-b63f-8db375af1ac8 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:58.358843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e050e-e056-4afd-b63f-8db375af1ac8 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:58.392966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67392c-9e62-4db3-aeb0-753e0f1ec634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:58.393690 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67392c-9e62-4db3-aeb0-753e0f1ec634 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:58.393971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67392c-9e62-4db3-aeb0-753e0f1ec634 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:58.394269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67392c-9e62-4db3-aeb0-753e0f1ec634 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:58.395554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67392c-9e62-4db3-aeb0-753e0f1ec634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:58.396997 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67392c-9e62-4db3-aeb0-753e0f1ec634 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:58.398704 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 562/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:40:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:40:58.404875 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a94f91-9269-45f7-91df-0a87bd188909 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:40:58.505285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a94f91-9269-45f7-91df-0a87bd188909 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:40:58.540179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9867ab4-93c2-4328-9c20-f5e9c9d30b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:40:58.541246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9867ab4-93c2-4328-9c20-f5e9c9d30b65 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:40:58.541521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9867ab4-93c2-4328-9c20-f5e9c9d30b65 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:40:58.541793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9867ab4-93c2-4328-9c20-f5e9c9d30b65 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:40:58.542591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9867ab4-93c2-4328-9c20-f5e9c9d30b65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:40:58.544033 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9867ab4-93c2-4328-9c20-f5e9c9d30b65 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:40:58.566065 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 576/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:40:58 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:41:00.928285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b23e74-3d03-46e0-91f9-2f1d33b40943 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:00.929114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b23e74-3d03-46e0-91f9-2f1d33b40943 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:00.929114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b23e74-3d03-46e0-91f9-2f1d33b40943 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:00.931865 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 563/1139] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:41:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:41:00.938302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5650c7-f2d1-43ff-9a80-c761098304d3 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:00.938717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5650c7-f2d1-43ff-9a80-c761098304d3 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:00.938887 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5650c7-f2d1-43ff-9a80-c761098304d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:00.963504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-3b5650c7-f2d1-43ff-9a80-c761098304d3 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:41:00.964690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3b5650c7-f2d1-43ff-9a80-c761098304d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:41:01.034237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 577/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:41:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:41:01.067727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b23e74-3d03-46e0-91f9-2f1d33b40943 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:01.169570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b23e74-3d03-46e0-91f9-2f1d33b40943 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:01.204251 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3a768-11cf-442b-b1a9-e07ffc726c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:01.204984 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3a768-11cf-442b-b1a9-e07ffc726c95 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:01.205266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3a768-11cf-442b-b1a9-e07ffc726c95 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:01.205527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3a768-11cf-442b-b1a9-e07ffc726c95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:01.218031 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3a768-11cf-442b-b1a9-e07ffc726c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:41:01.224880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-58f3a768-11cf-442b-b1a9-e07ffc726c95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:41:01.226073 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 564/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:41:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:41:01.235540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5650c7-f2d1-43ff-9a80-c761098304d3 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:01.335161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5650c7-f2d1-43ff-9a80-c761098304d3 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:01.368171 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da03cb0-c773-4e81-a927-8f9f3e2b2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:01.368841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da03cb0-c773-4e81-a927-8f9f3e2b2042 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:01.369115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da03cb0-c773-4e81-a927-8f9f3e2b2042 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:01.369391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da03cb0-c773-4e81-a927-8f9f3e2b2042 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:01.370146 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da03cb0-c773-4e81-a927-8f9f3e2b2042 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:01.370463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da03cb0-c773-4e81-a927-8f9f3e2b2042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:01.371833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da03cb0-c773-4e81-a927-8f9f3e2b2042 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:01.379644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 578/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:41:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:01.388010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3a768-11cf-442b-b1a9-e07ffc726c95 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:01.495304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3a768-11cf-442b-b1a9-e07ffc726c95 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:01.527131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c650b-137c-4192-98af-2b7ed48bcc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:01.527988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c650b-137c-4192-98af-2b7ed48bcc48 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:01.528269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c650b-137c-4192-98af-2b7ed48bcc48 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:01.528535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c650b-137c-4192-98af-2b7ed48bcc48 None admin] PATH_INFO: `/v3/users/4638de66cf7d4550b970a7d97b7f8e0a` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:01.546804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c650b-137c-4192-98af-2b7ed48bcc48 None admin] RBAC: Authorizing `identity:get_user(user_id=4638de66cf7d4550b970a7d97b7f8e0a)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:01.549108 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c650b-137c-4192-98af-2b7ed48bcc48 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:01.551796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 565/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:41:01 2022] GET /identity/v3/users/4638de66cf7d4550b970a7d97b7f8e0a => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:01.559374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da03cb0-c773-4e81-a927-8f9f3e2b2042 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:01.663255 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da03cb0-c773-4e81-a927-8f9f3e2b2042 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:01.696107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee30b1d-0492-4582-ac40-d1165269e8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:01.696753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30b1d-0492-4582-ac40-d1165269e8c8 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:01.697058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30b1d-0492-4582-ac40-d1165269e8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:01.697326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30b1d-0492-4582-ac40-d1165269e8c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:01.763059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee30b1d-0492-4582-ac40-d1165269e8c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:01.764436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee30b1d-0492-4582-ac40-d1165269e8c8 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:01.859409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 579/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:41:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:41:01.868981 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c650b-137c-4192-98af-2b7ed48bcc48 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:01.970125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c650b-137c-4192-98af-2b7ed48bcc48 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:02.008097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97efe7d-ed18-4100-a64e-8baf5cf79352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:02.008945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97efe7d-ed18-4100-a64e-8baf5cf79352 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:02.009217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97efe7d-ed18-4100-a64e-8baf5cf79352 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:02.009538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97efe7d-ed18-4100-a64e-8baf5cf79352 None admin] PATH_INFO: `/v3/projects/8261deab3b77411fbe84589e6b4c315e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:02.010864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97efe7d-ed18-4100-a64e-8baf5cf79352 None admin] RBAC: Authorizing `identity:get_project(project_id=8261deab3b77411fbe84589e6b4c315e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:02.012293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97efe7d-ed18-4100-a64e-8baf5cf79352 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:02.014049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 566/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:41:01 2022] GET /identity/v3/projects/8261deab3b77411fbe84589e6b4c315e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:02.020519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee30b1d-0492-4582-ac40-d1165269e8c8 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:02.116535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee30b1d-0492-4582-ac40-d1165269e8c8 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:02.150495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea26deb-a9f6-4df2-a89c-0b89d6d325bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:02.151137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea26deb-a9f6-4df2-a89c-0b89d6d325bd None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:02.151417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea26deb-a9f6-4df2-a89c-0b89d6d325bd None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:02.151692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea26deb-a9f6-4df2-a89c-0b89d6d325bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:02.152519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea26deb-a9f6-4df2-a89c-0b89d6d325bd None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=8261deab3b77411fbe84589e6b4c315e, user.id=4638de66cf7d4550b970a7d97b7f8e0a) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:02.152828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea26deb-a9f6-4df2-a89c-0b89d6d325bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:02.154301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea26deb-a9f6-4df2-a89c-0b89d6d325bd None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:02.159709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 580/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:41:02 2022] GET /identity/v3/role_assignments?user.id=4638de66cf7d4550b970a7d97b7f8e0a&scope.project.id=8261deab3b77411fbe84589e6b4c315e&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:04.427138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c92d8-2ead-4a9e-8449-f041e536339b None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:04.427753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c92d8-2ead-4a9e-8449-f041e536339b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:04.427753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c92d8-2ead-4a9e-8449-f041e536339b None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:04.430459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 567/1147] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:41:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:41:04.439382 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24f4a-acda-462e-ae2d-d12410331690 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:04.439800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24f4a-acda-462e-ae2d-d12410331690 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:04.439935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24f4a-acda-462e-ae2d-d12410331690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:04.461057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-bfc24f4a-acda-462e-ae2d-d12410331690 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:41:04.462398 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-bfc24f4a-acda-462e-ae2d-d12410331690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:41:04.531829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 581/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:41:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:41:04.554991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c92d8-2ead-4a9e-8449-f041e536339b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:04.661398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c92d8-2ead-4a9e-8449-f041e536339b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:04.700811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53215444-14f7-47e6-86d8-c0099c2144d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:04.701564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53215444-14f7-47e6-86d8-c0099c2144d1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:04.701834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53215444-14f7-47e6-86d8-c0099c2144d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:04.702128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53215444-14f7-47e6-86d8-c0099c2144d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:04.714350 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53215444-14f7-47e6-86d8-c0099c2144d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:41:04.721250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-53215444-14f7-47e6-86d8-c0099c2144d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:41:04.722492 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 568/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:41:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:41:04.728921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc24f4a-acda-462e-ae2d-d12410331690 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:04.835417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc24f4a-acda-462e-ae2d-d12410331690 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:04.869036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc58a8-c175-497b-a779-e2ae1c0ca43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:04.869703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc58a8-c175-497b-a779-e2ae1c0ca43e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:04.869981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc58a8-c175-497b-a779-e2ae1c0ca43e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:04.870285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc58a8-c175-497b-a779-e2ae1c0ca43e None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:04.871038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc58a8-c175-497b-a779-e2ae1c0ca43e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:04.871340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc58a8-c175-497b-a779-e2ae1c0ca43e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:04.872716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc58a8-c175-497b-a779-e2ae1c0ca43e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:04.880753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 582/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:41:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:04.889682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53215444-14f7-47e6-86d8-c0099c2144d1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:04.990043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53215444-14f7-47e6-86d8-c0099c2144d1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:05.024302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c0b08-3111-4329-b4d4-3e2e28e7d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:05.025205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c0b08-3111-4329-b4d4-3e2e28e7d1f9 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:05.025480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c0b08-3111-4329-b4d4-3e2e28e7d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:05.025749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c0b08-3111-4329-b4d4-3e2e28e7d1f9 None admin] PATH_INFO: `/v3/users/4638de66cf7d4550b970a7d97b7f8e0a` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:05.027088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c0b08-3111-4329-b4d4-3e2e28e7d1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=4638de66cf7d4550b970a7d97b7f8e0a)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:05.028524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c0b08-3111-4329-b4d4-3e2e28e7d1f9 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:05.030124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 569/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:41:04 2022] GET /identity/v3/users/4638de66cf7d4550b970a7d97b7f8e0a => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:41:05.036829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc58a8-c175-497b-a779-e2ae1c0ca43e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:05.152289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc58a8-c175-497b-a779-e2ae1c0ca43e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:05.187431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6b43-0f57-44f5-bc69-49a86eae650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:05.188278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6b43-0f57-44f5-bc69-49a86eae650e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:05.188547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6b43-0f57-44f5-bc69-49a86eae650e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:05.188810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6b43-0f57-44f5-bc69-49a86eae650e None admin] PATH_INFO: `/v3/projects/8261deab3b77411fbe84589e6b4c315e` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:05.190138 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6b43-0f57-44f5-bc69-49a86eae650e None admin] RBAC: Authorizing `identity:get_project(project_id=8261deab3b77411fbe84589e6b4c315e)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:05.191551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6b43-0f57-44f5-bc69-49a86eae650e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:05.193198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 583/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:41:05 2022] GET /identity/v3/projects/8261deab3b77411fbe84589e6b4c315e => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:05.200584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c0b08-3111-4329-b4d4-3e2e28e7d1f9 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:05.303350 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c0b08-3111-4329-b4d4-3e2e28e7d1f9 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:05.336769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89c4ef-67c4-4711-883b-a7cc4082f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:05.337700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89c4ef-67c4-4711-883b-a7cc4082f2d5 None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:05.337978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89c4ef-67c4-4711-883b-a7cc4082f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:05.338286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89c4ef-67c4-4711-883b-a7cc4082f2d5 None admin] PATH_INFO: `/v3/projects/8261deab3b77411fbe84589e6b4c315e/users/4638de66cf7d4550b970a7d97b7f8e0a/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:05.340502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89c4ef-67c4-4711-883b-a7cc4082f2d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8261deab3b77411fbe84589e6b4c315e, user_id=4638de66cf7d4550b970a7d97b7f8e0a, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:05.341931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89c4ef-67c4-4711-883b-a7cc4082f2d5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:05.363439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 570/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:41:05 2022] PUT /identity/v3/projects/8261deab3b77411fbe84589e6b4c315e/users/4638de66cf7d4550b970a7d97b7f8e0a/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:41:07.645027 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d8b3f-74ee-4cdf-9ddb-17c78de903b6 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:07.645755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d8b3f-74ee-4cdf-9ddb-17c78de903b6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:07.645925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d8b3f-74ee-4cdf-9ddb-17c78de903b6 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:07.648779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 584/1154] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:41:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:41:07.654937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7ceab-8b9c-4c03-ab7a-d79a34350bad None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:07.655336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7ceab-8b9c-4c03-ab7a-d79a34350bad None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:07.655474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7ceab-8b9c-4c03-ab7a-d79a34350bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:07.673519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c4e7ceab-8b9c-4c03-ab7a-d79a34350bad None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:41:07.674729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c4e7ceab-8b9c-4c03-ab7a-d79a34350bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:41:07.750229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 571/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:41:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:41:07.783511 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d8b3f-74ee-4cdf-9ddb-17c78de903b6 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:07.885535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d8b3f-74ee-4cdf-9ddb-17c78de903b6 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:07.918897 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d9efb-9cad-493b-8cc6-d9b3473bcf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:07.919610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d9efb-9cad-493b-8cc6-d9b3473bcf8b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:07.919858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d9efb-9cad-493b-8cc6-d9b3473bcf8b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:07.920196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d9efb-9cad-493b-8cc6-d9b3473bcf8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:07.931618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d9efb-9cad-493b-8cc6-d9b3473bcf8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:41:07.943258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-0e3d9efb-9cad-493b-8cc6-d9b3473bcf8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:41:07.945123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 585/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:41:07.951354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7ceab-8b9c-4c03-ab7a-d79a34350bad None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:08.055540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7ceab-8b9c-4c03-ab7a-d79a34350bad None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:08.089723 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a9ca4-5492-48c7-9b5c-9f12d7bec5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:08.090416 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a9ca4-5492-48c7-9b5c-9f12d7bec5fc None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:08.090690 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a9ca4-5492-48c7-9b5c-9f12d7bec5fc None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:08.090961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a9ca4-5492-48c7-9b5c-9f12d7bec5fc None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:08.091704 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a9ca4-5492-48c7-9b5c-9f12d7bec5fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:08.092010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a9ca4-5492-48c7-9b5c-9f12d7bec5fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:08.093379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a9ca4-5492-48c7-9b5c-9f12d7bec5fc None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:08.101461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 572/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:08.107884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d9efb-9cad-493b-8cc6-d9b3473bcf8b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:08.215371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d9efb-9cad-493b-8cc6-d9b3473bcf8b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:08.253999 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95794f-3b11-4aec-8f3c-b74cd2b9473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:08.254902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95794f-3b11-4aec-8f3c-b74cd2b9473a None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:08.255182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95794f-3b11-4aec-8f3c-b74cd2b9473a None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:08.255459 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95794f-3b11-4aec-8f3c-b74cd2b9473a None admin] PATH_INFO: `/v3/users/4638de66cf7d4550b970a7d97b7f8e0a` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:08.256710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95794f-3b11-4aec-8f3c-b74cd2b9473a None admin] RBAC: Authorizing `identity:get_user(user_id=4638de66cf7d4550b970a7d97b7f8e0a)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:08.258187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95794f-3b11-4aec-8f3c-b74cd2b9473a None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:08.259971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 586/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:41:08 2022] GET /identity/v3/users/4638de66cf7d4550b970a7d97b7f8e0a => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:41:08.266175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a9ca4-5492-48c7-9b5c-9f12d7bec5fc None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:08.365705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a9ca4-5492-48c7-9b5c-9f12d7bec5fc None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:08.402384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5cfdb-254e-4918-9d2e-2543c908717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:08.403013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5cfdb-254e-4918-9d2e-2543c908717d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:08.403292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5cfdb-254e-4918-9d2e-2543c908717d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:08.403557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5cfdb-254e-4918-9d2e-2543c908717d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:08.468667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5cfdb-254e-4918-9d2e-2543c908717d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:08.470037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5cfdb-254e-4918-9d2e-2543c908717d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:08.570458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 573/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:41:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:41:08.576591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95794f-3b11-4aec-8f3c-b74cd2b9473a None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:08.690239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95794f-3b11-4aec-8f3c-b74cd2b9473a None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:08.723573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efef177-9b4e-4d9b-be9f-2d1d29f2a109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:08.724378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efef177-9b4e-4d9b-be9f-2d1d29f2a109 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:08.724656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efef177-9b4e-4d9b-be9f-2d1d29f2a109 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:08.724915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efef177-9b4e-4d9b-be9f-2d1d29f2a109 None admin] PATH_INFO: `/v3/projects/8261deab3b77411fbe84589e6b4c315e` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:08.726161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efef177-9b4e-4d9b-be9f-2d1d29f2a109 None admin] RBAC: Authorizing `identity:get_project(project_id=8261deab3b77411fbe84589e6b4c315e)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:08.727655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efef177-9b4e-4d9b-be9f-2d1d29f2a109 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:08.729358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 587/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:41:08 2022] GET /identity/v3/projects/8261deab3b77411fbe84589e6b4c315e => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:08.735818 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5cfdb-254e-4918-9d2e-2543c908717d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:08.847069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5cfdb-254e-4918-9d2e-2543c908717d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:08.886672 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ab240-789c-4fa2-a9f1-a61fe1c1abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:08.887660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ab240-789c-4fa2-a9f1-a61fe1c1abed None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:08.888086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ab240-789c-4fa2-a9f1-a61fe1c1abed None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:08.888473 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ab240-789c-4fa2-a9f1-a61fe1c1abed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:08.889797 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ab240-789c-4fa2-a9f1-a61fe1c1abed None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=8261deab3b77411fbe84589e6b4c315e, user.id=4638de66cf7d4550b970a7d97b7f8e0a) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:08.890317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ab240-789c-4fa2-a9f1-a61fe1c1abed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:08.892595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ab240-789c-4fa2-a9f1-a61fe1c1abed None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:08.902327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 574/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:41:08 2022] GET /identity/v3/role_assignments?user.id=4638de66cf7d4550b970a7d97b7f8e0a&scope.project.id=8261deab3b77411fbe84589e6b4c315e&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:11.228693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fe4fb-c657-493d-b348-d1e7af77b2cd None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:11.229253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fe4fb-c657-493d-b348-d1e7af77b2cd None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:11.229253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fe4fb-c657-493d-b348-d1e7af77b2cd None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:11.231088 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 588/1162] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:41:11.237406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791ca09-11f3-4add-a7ee-18063a35ae4b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:11.238158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791ca09-11f3-4add-a7ee-18063a35ae4b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:11.238286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791ca09-11f3-4add-a7ee-18063a35ae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:11.259216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0791ca09-11f3-4add-a7ee-18063a35ae4b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:41:11.260387 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0791ca09-11f3-4add-a7ee-18063a35ae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:41:11.341258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 575/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:41:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:41:11.374496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fe4fb-c657-493d-b348-d1e7af77b2cd None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:11.480846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fe4fb-c657-493d-b348-d1e7af77b2cd None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:11.515342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3b29d-3c50-4beb-b549-9d8171ebe9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:11.515974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b29d-3c50-4beb-b549-9d8171ebe9c9 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:11.516248 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b29d-3c50-4beb-b549-9d8171ebe9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:11.516518 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b29d-3c50-4beb-b549-9d8171ebe9c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:11.583269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3b29d-3c50-4beb-b549-9d8171ebe9c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:11.584709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3b29d-3c50-4beb-b549-9d8171ebe9c9 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:11.692613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 589/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:41:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:41:11.699789 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791ca09-11f3-4add-a7ee-18063a35ae4b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:11.808917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791ca09-11f3-4add-a7ee-18063a35ae4b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:11.843345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee049ca-3c29-4e2f-8afb-9629dabba43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:11.844151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee049ca-3c29-4e2f-8afb-9629dabba43d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:11.844427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee049ca-3c29-4e2f-8afb-9629dabba43d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:11.844694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee049ca-3c29-4e2f-8afb-9629dabba43d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:11.852744 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee049ca-3c29-4e2f-8afb-9629dabba43d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:11.854228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee049ca-3c29-4e2f-8afb-9629dabba43d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:11.868490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-5ee049ca-3c29-4e2f-8afb-9629dabba43d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 28 19:41:11.869765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 576/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Oct 28 19:41:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:41:11.876043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3b29d-3c50-4beb-b549-9d8171ebe9c9 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:11.973291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3b29d-3c50-4beb-b549-9d8171ebe9c9 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:12.007149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9642d9-7720-403e-8db0-5089bcfb870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:12.007799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9642d9-7720-403e-8db0-5089bcfb870f None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:12.008075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9642d9-7720-403e-8db0-5089bcfb870f None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:12.008433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9642d9-7720-403e-8db0-5089bcfb870f None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:12.009830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9642d9-7720-403e-8db0-5089bcfb870f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:12.010318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9642d9-7720-403e-8db0-5089bcfb870f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:12.012504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9642d9-7720-403e-8db0-5089bcfb870f None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:12.024335 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 590/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Oct 28 19:41:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:14.317308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4708c9-84e4-409e-b042-a8e17db2cce4 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:14.317848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4708c9-84e4-409e-b042-a8e17db2cce4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:14.317848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4708c9-84e4-409e-b042-a8e17db2cce4 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:14.319642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 577/1167] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:41:14.325142 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba348-11ed-4208-a49d-65ea247b7c7b None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:14.325537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba348-11ed-4208-a49d-65ea247b7c7b None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:14.325765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba348-11ed-4208-a49d-65ea247b7c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:14.343564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-55aba348-11ed-4208-a49d-65ea247b7c7b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:41:14.344743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-55aba348-11ed-4208-a49d-65ea247b7c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:41:14.417513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 591/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:41:14.433442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4708c9-84e4-409e-b042-a8e17db2cce4 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:14.529420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4708c9-84e4-409e-b042-a8e17db2cce4 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:14.562345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146fbca-768c-4b30-b0c4-e386dc0c3251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:14.563000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146fbca-768c-4b30-b0c4-e386dc0c3251 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:14.563274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146fbca-768c-4b30-b0c4-e386dc0c3251 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:14.563535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146fbca-768c-4b30-b0c4-e386dc0c3251 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:14.564279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146fbca-768c-4b30-b0c4-e386dc0c3251 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:14.565638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146fbca-768c-4b30-b0c4-e386dc0c3251 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:14.582475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 578/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Fri Oct 28 19:41:14 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:41:16.929085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492873d-3179-47a2-ba7e-94645b32f032 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:16.929909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492873d-3179-47a2-ba7e-94645b32f032 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:16.929909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492873d-3179-47a2-ba7e-94645b32f032 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:16.932716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 592/1170] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:41:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:41:16.938998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a19d0-f26d-4eee-8e03-9cfdb52fc4bf None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:16.939420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a19d0-f26d-4eee-8e03-9cfdb52fc4bf None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:16.939526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a19d0-f26d-4eee-8e03-9cfdb52fc4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:16.959467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-9c5a19d0-f26d-4eee-8e03-9cfdb52fc4bf None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:41:16.960644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9c5a19d0-f26d-4eee-8e03-9cfdb52fc4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:41:17.029893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 579/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:41:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:41:17.058304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492873d-3179-47a2-ba7e-94645b32f032 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:17.168463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492873d-3179-47a2-ba7e-94645b32f032 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:17.202491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe233b4-1e23-4e36-853f-0be47a810150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:17.203307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe233b4-1e23-4e36-853f-0be47a810150 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:17.203567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe233b4-1e23-4e36-853f-0be47a810150 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:17.203839 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe233b4-1e23-4e36-853f-0be47a810150 None admin] PATH_INFO: `/v3/domains/8e7749d62d2545248a53f1e4bd01170a` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:17.214721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe233b4-1e23-4e36-853f-0be47a810150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8e7749d62d2545248a53f1e4bd01170a)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:17.216184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe233b4-1e23-4e36-853f-0be47a810150 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:17.217801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 593/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Oct 28 19:41:17 2022] GET /identity/v3/domains/8e7749d62d2545248a53f1e4bd01170a => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:17.223909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a19d0-f26d-4eee-8e03-9cfdb52fc4bf None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:17.325294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a19d0-f26d-4eee-8e03-9cfdb52fc4bf None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:17.358627 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed70e5-408f-406d-9266-ee7c3c309030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:17.359268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed70e5-408f-406d-9266-ee7c3c309030 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:17.359542 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed70e5-408f-406d-9266-ee7c3c309030 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:17.359808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed70e5-408f-406d-9266-ee7c3c309030 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:17.360506 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed70e5-408f-406d-9266-ee7c3c309030 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:17.361932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed70e5-408f-406d-9266-ee7c3c309030 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:17.395001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 580/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:41:17 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:41:19.721358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68435d-8ad3-4e86-9ede-c7585dd3f928 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:19.722215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68435d-8ad3-4e86-9ede-c7585dd3f928 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:19.722358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68435d-8ad3-4e86-9ede-c7585dd3f928 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:19.725259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 594/1174] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:41:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:41:19.735550 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b81932-3c6a-424c-ad90-dfa30bb1e825 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:19.735987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b81932-3c6a-424c-ad90-dfa30bb1e825 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:19.736121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b81932-3c6a-424c-ad90-dfa30bb1e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:19.757746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-45b81932-3c6a-424c-ad90-dfa30bb1e825 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:41:19.758923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-45b81932-3c6a-424c-ad90-dfa30bb1e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:41:19.825750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 581/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:41:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:41:19.854803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68435d-8ad3-4e86-9ede-c7585dd3f928 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:19.966407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68435d-8ad3-4e86-9ede-c7585dd3f928 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:20.000569 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584210e5-d99d-4f51-abb7-90d6f45cea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:20.001435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584210e5-d99d-4f51-abb7-90d6f45cea0e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:20.001709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584210e5-d99d-4f51-abb7-90d6f45cea0e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:20.001977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584210e5-d99d-4f51-abb7-90d6f45cea0e None admin] PATH_INFO: `/v3/domains/8e7749d62d2545248a53f1e4bd01170a` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:20.003287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584210e5-d99d-4f51-abb7-90d6f45cea0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=8e7749d62d2545248a53f1e4bd01170a)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:20.004718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584210e5-d99d-4f51-abb7-90d6f45cea0e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:20.006333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 595/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Oct 28 19:41:19 2022] GET /identity/v3/domains/8e7749d62d2545248a53f1e4bd01170a => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:20.012845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b81932-3c6a-424c-ad90-dfa30bb1e825 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:20.123134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b81932-3c6a-424c-ad90-dfa30bb1e825 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:20.157055 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03e88-1340-4417-8dde-00bba1379779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:20.157715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03e88-1340-4417-8dde-00bba1379779 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:20.157995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03e88-1340-4417-8dde-00bba1379779 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:20.158303 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03e88-1340-4417-8dde-00bba1379779 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:20.159000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03e88-1340-4417-8dde-00bba1379779 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:20.160429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03e88-1340-4417-8dde-00bba1379779 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:20.183756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 582/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:41:20 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:41:22.537661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89d558-93b9-4359-b14a-abe0a668b676 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:22.539001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89d558-93b9-4359-b14a-abe0a668b676 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:22.539001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89d558-93b9-4359-b14a-abe0a668b676 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:22.541750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 596/1178] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:41:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:41:22.548231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422629e9-fb96-4251-b9d2-47342babdfa6 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:22.548923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422629e9-fb96-4251-b9d2-47342babdfa6 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:22.549105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422629e9-fb96-4251-b9d2-47342babdfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:22.568894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-422629e9-fb96-4251-b9d2-47342babdfa6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:41:22.570057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-422629e9-fb96-4251-b9d2-47342babdfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:41:22.637436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 583/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:41:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:41:22.661312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89d558-93b9-4359-b14a-abe0a668b676 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:22.763568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89d558-93b9-4359-b14a-abe0a668b676 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:22.811397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd7eaf-b246-4d98-9b85-8a292c43ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:22.812143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd7eaf-b246-4d98-9b85-8a292c43ade7 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:22.812430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd7eaf-b246-4d98-9b85-8a292c43ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:22.812706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd7eaf-b246-4d98-9b85-8a292c43ade7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:22.823784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd7eaf-b246-4d98-9b85-8a292c43ade7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:41:22.830849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-3afd7eaf-b246-4d98-9b85-8a292c43ade7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:41:22.832015 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 597/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:41:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:41:22.838431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422629e9-fb96-4251-b9d2-47342babdfa6 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:22.937860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422629e9-fb96-4251-b9d2-47342babdfa6 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:22.971993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4631-f30c-4461-a2eb-2936a51e7c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:22.972648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4631-f30c-4461-a2eb-2936a51e7c81 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:22.972926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4631-f30c-4461-a2eb-2936a51e7c81 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:22.973195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4631-f30c-4461-a2eb-2936a51e7c81 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:22.973936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f4631-f30c-4461-a2eb-2936a51e7c81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:22.974273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f4631-f30c-4461-a2eb-2936a51e7c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:22.975641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f4631-f30c-4461-a2eb-2936a51e7c81 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:22.983826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 584/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:41:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:22.990216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd7eaf-b246-4d98-9b85-8a292c43ade7 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:23.103699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd7eaf-b246-4d98-9b85-8a292c43ade7 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:23.139880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30d731-d745-410f-b47f-4359890fcdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:23.140780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30d731-d745-410f-b47f-4359890fcdda None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:23.141071 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30d731-d745-410f-b47f-4359890fcdda None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:23.141322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30d731-d745-410f-b47f-4359890fcdda None admin] PATH_INFO: `/v3/users/c25810152aa045f8b913bc513e9e85eb` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:23.156063 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30d731-d745-410f-b47f-4359890fcdda None admin] RBAC: Authorizing `identity:get_user(user_id=c25810152aa045f8b913bc513e9e85eb)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:23.157510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30d731-d745-410f-b47f-4359890fcdda None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:23.159174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 598/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:41:22 2022] GET /identity/v3/users/c25810152aa045f8b913bc513e9e85eb => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:23.165710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4631-f30c-4461-a2eb-2936a51e7c81 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:23.279736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4631-f30c-4461-a2eb-2936a51e7c81 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:23.314372 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b9eae-8c3a-44fa-9489-fc9cac04072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:23.315008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b9eae-8c3a-44fa-9489-fc9cac04072e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:23.315293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b9eae-8c3a-44fa-9489-fc9cac04072e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:23.315570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b9eae-8c3a-44fa-9489-fc9cac04072e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:23.382164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b9eae-8c3a-44fa-9489-fc9cac04072e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:23.383593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b9eae-8c3a-44fa-9489-fc9cac04072e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:23.487611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 585/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:41:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:41:23.493717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30d731-d745-410f-b47f-4359890fcdda None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:23.597993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30d731-d745-410f-b47f-4359890fcdda None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:23.632292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6314da5-7fe3-4f90-8e7d-d0a9eccd186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:23.633134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6314da5-7fe3-4f90-8e7d-d0a9eccd186b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:23.633412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6314da5-7fe3-4f90-8e7d-d0a9eccd186b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:23.633683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6314da5-7fe3-4f90-8e7d-d0a9eccd186b None admin] PATH_INFO: `/v3/projects/9e35a8b8c43f4b009077cedab6149e48` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:23.635010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6314da5-7fe3-4f90-8e7d-d0a9eccd186b None admin] RBAC: Authorizing `identity:get_project(project_id=9e35a8b8c43f4b009077cedab6149e48)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:23.636446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6314da5-7fe3-4f90-8e7d-d0a9eccd186b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:23.638107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 599/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:41:23 2022] GET /identity/v3/projects/9e35a8b8c43f4b009077cedab6149e48 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:23.646483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b9eae-8c3a-44fa-9489-fc9cac04072e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:23.750195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b9eae-8c3a-44fa-9489-fc9cac04072e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:23.786868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6686-9af0-466f-befa-c3ac881109ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:23.787532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6686-9af0-466f-befa-c3ac881109ac None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:23.787813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6686-9af0-466f-befa-c3ac881109ac None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:23.788086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6686-9af0-466f-befa-c3ac881109ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:23.789298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6686-9af0-466f-befa-c3ac881109ac None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=9e35a8b8c43f4b009077cedab6149e48, user.id=c25810152aa045f8b913bc513e9e85eb) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:23.789605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6686-9af0-466f-befa-c3ac881109ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:23.791078 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6686-9af0-466f-befa-c3ac881109ac None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:23.796841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 586/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:41:23 2022] GET /identity/v3/role_assignments?user.id=c25810152aa045f8b913bc513e9e85eb&scope.project.id=9e35a8b8c43f4b009077cedab6149e48&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:26.083963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c611e29-b1f2-43a7-8fb5-7327ebd1aa1d None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:26.084635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c611e29-b1f2-43a7-8fb5-7327ebd1aa1d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:26.084635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c611e29-b1f2-43a7-8fb5-7327ebd1aa1d None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:26.086376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 600/1186] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:41:26.092767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0103f5-e425-4ad6-9df4-377bac0f5c0d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:26.093484 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0103f5-e425-4ad6-9df4-377bac0f5c0d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:26.093626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0103f5-e425-4ad6-9df4-377bac0f5c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:26.114453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0a0103f5-e425-4ad6-9df4-377bac0f5c0d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:41:26.115650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0a0103f5-e425-4ad6-9df4-377bac0f5c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:41:26.186198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 587/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:41:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:41:26.208707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c611e29-b1f2-43a7-8fb5-7327ebd1aa1d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:26.312802 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c611e29-b1f2-43a7-8fb5-7327ebd1aa1d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:26.349593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217fd42-f4fb-4cf5-8589-aa827a30b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:26.350335 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217fd42-f4fb-4cf5-8589-aa827a30b40c None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:26.350625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217fd42-f4fb-4cf5-8589-aa827a30b40c None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:26.350889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217fd42-f4fb-4cf5-8589-aa827a30b40c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:26.361508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217fd42-f4fb-4cf5-8589-aa827a30b40c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:41:26.368843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-8217fd42-f4fb-4cf5-8589-aa827a30b40c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:41:26.369992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 601/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:41:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:41:26.376783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0103f5-e425-4ad6-9df4-377bac0f5c0d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:26.479475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0103f5-e425-4ad6-9df4-377bac0f5c0d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:26.512930 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7348-1fb7-4ae2-9957-c4e93c0f5f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:26.513577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7348-1fb7-4ae2-9957-c4e93c0f5f30 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:26.513862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7348-1fb7-4ae2-9957-c4e93c0f5f30 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:26.514124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7348-1fb7-4ae2-9957-c4e93c0f5f30 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:26.514893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7348-1fb7-4ae2-9957-c4e93c0f5f30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:26.515197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7348-1fb7-4ae2-9957-c4e93c0f5f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:26.516593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7348-1fb7-4ae2-9957-c4e93c0f5f30 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:26.524639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 588/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:41:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:26.530718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217fd42-f4fb-4cf5-8589-aa827a30b40c None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:26.641418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217fd42-f4fb-4cf5-8589-aa827a30b40c None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:26.674334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c7c67-8794-4aac-90eb-3170c96a4466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:26.675215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c7c67-8794-4aac-90eb-3170c96a4466 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:26.675488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c7c67-8794-4aac-90eb-3170c96a4466 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:26.675750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c7c67-8794-4aac-90eb-3170c96a4466 None admin] PATH_INFO: `/v3/users/c25810152aa045f8b913bc513e9e85eb` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:26.676924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c7c67-8794-4aac-90eb-3170c96a4466 None admin] RBAC: Authorizing `identity:get_user(user_id=c25810152aa045f8b913bc513e9e85eb)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:26.678374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c7c67-8794-4aac-90eb-3170c96a4466 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:26.680003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 602/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:41:26 2022] GET /identity/v3/users/c25810152aa045f8b913bc513e9e85eb => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:26.686107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7348-1fb7-4ae2-9957-c4e93c0f5f30 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:26.792076 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7348-1fb7-4ae2-9957-c4e93c0f5f30 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:26.825222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba880c-e811-4ba9-ae04-5a8b25f96736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:26.826074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba880c-e811-4ba9-ae04-5a8b25f96736 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:26.826380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba880c-e811-4ba9-ae04-5a8b25f96736 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:26.826655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba880c-e811-4ba9-ae04-5a8b25f96736 None admin] PATH_INFO: `/v3/projects/9e35a8b8c43f4b009077cedab6149e48` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:26.827867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba880c-e811-4ba9-ae04-5a8b25f96736 None admin] RBAC: Authorizing `identity:get_project(project_id=9e35a8b8c43f4b009077cedab6149e48)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:26.829285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba880c-e811-4ba9-ae04-5a8b25f96736 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:26.830977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 589/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:41:26 2022] GET /identity/v3/projects/9e35a8b8c43f4b009077cedab6149e48 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:26.839904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c7c67-8794-4aac-90eb-3170c96a4466 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:26.941298 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c7c67-8794-4aac-90eb-3170c96a4466 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:26.974726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33faa2bc-c532-48c3-bc19-cd724541d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:26.975602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faa2bc-c532-48c3-bc19-cd724541d9be None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:26.975871 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faa2bc-c532-48c3-bc19-cd724541d9be None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:26.976135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faa2bc-c532-48c3-bc19-cd724541d9be None admin] PATH_INFO: `/v3/projects/9e35a8b8c43f4b009077cedab6149e48/users/c25810152aa045f8b913bc513e9e85eb/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:26.978545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33faa2bc-c532-48c3-bc19-cd724541d9be None admin] RBAC: Authorizing `identity:create_grant(project_id=9e35a8b8c43f4b009077cedab6149e48, user_id=c25810152aa045f8b913bc513e9e85eb, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:26.979990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33faa2bc-c532-48c3-bc19-cd724541d9be None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:26.996778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 603/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:41:26 2022] PUT /identity/v3/projects/9e35a8b8c43f4b009077cedab6149e48/users/c25810152aa045f8b913bc513e9e85eb/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:41:29.282495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7409-c4c4-49df-ac60-699977c3ec87 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:29.283352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7409-c4c4-49df-ac60-699977c3ec87 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:29.283352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7409-c4c4-49df-ac60-699977c3ec87 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:29.286175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 590/1193] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:41:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:41:29.295570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a4239-3ca4-40c4-a367-52a0d77730dd None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:29.296280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a4239-3ca4-40c4-a367-52a0d77730dd None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:29.296467 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a4239-3ca4-40c4-a367-52a0d77730dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:29.316931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0c1a4239-3ca4-40c4-a367-52a0d77730dd None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:41:29.318104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0c1a4239-3ca4-40c4-a367-52a0d77730dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:41:29.387976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 604/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:41:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:41:29.411740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a7409-c4c4-49df-ac60-699977c3ec87 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:29.523275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a7409-c4c4-49df-ac60-699977c3ec87 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:29.557172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428f018-a0f3-4f1a-9548-91049f4318b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:29.557886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428f018-a0f3-4f1a-9548-91049f4318b3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:29.558195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428f018-a0f3-4f1a-9548-91049f4318b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:29.558460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428f018-a0f3-4f1a-9548-91049f4318b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:29.569567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428f018-a0f3-4f1a-9548-91049f4318b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:41:29.576429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-3428f018-a0f3-4f1a-9548-91049f4318b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:41:29.577575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 591/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:41:29.584289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a4239-3ca4-40c4-a367-52a0d77730dd None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:29.685519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a4239-3ca4-40c4-a367-52a0d77730dd None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:29.718505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81c3cc-bee1-4778-a10b-e2476d107f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:29.719151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81c3cc-bee1-4778-a10b-e2476d107f45 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:29.719404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81c3cc-bee1-4778-a10b-e2476d107f45 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:29.719670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81c3cc-bee1-4778-a10b-e2476d107f45 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:29.720403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81c3cc-bee1-4778-a10b-e2476d107f45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:29.720698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81c3cc-bee1-4778-a10b-e2476d107f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:29.722058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81c3cc-bee1-4778-a10b-e2476d107f45 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:29.730370 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 605/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:41:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:29.736943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428f018-a0f3-4f1a-9548-91049f4318b3 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:29.846585 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428f018-a0f3-4f1a-9548-91049f4318b3 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:29.883577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96142e06-74f9-4dea-8286-96b7107fb5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:29.884433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96142e06-74f9-4dea-8286-96b7107fb5cc None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:29.884689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96142e06-74f9-4dea-8286-96b7107fb5cc None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:29.884986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96142e06-74f9-4dea-8286-96b7107fb5cc None admin] PATH_INFO: `/v3/users/c25810152aa045f8b913bc513e9e85eb` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:29.886317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96142e06-74f9-4dea-8286-96b7107fb5cc None admin] RBAC: Authorizing `identity:get_user(user_id=c25810152aa045f8b913bc513e9e85eb)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:29.887753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96142e06-74f9-4dea-8286-96b7107fb5cc None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:29.889360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 592/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Oct 28 19:41:29 2022] GET /identity/v3/users/c25810152aa045f8b913bc513e9e85eb => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:29.895456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81c3cc-bee1-4778-a10b-e2476d107f45 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:30.007066 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81c3cc-bee1-4778-a10b-e2476d107f45 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:30.040601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be989b0b-2e6c-4422-addc-b0d7777e0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:30.041227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be989b0b-2e6c-4422-addc-b0d7777e0dba None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:30.041508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be989b0b-2e6c-4422-addc-b0d7777e0dba None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:30.041759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be989b0b-2e6c-4422-addc-b0d7777e0dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:30.106469 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be989b0b-2e6c-4422-addc-b0d7777e0dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:30.107839 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be989b0b-2e6c-4422-addc-b0d7777e0dba None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:30.202924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 606/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:41:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:41:30.212527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96142e06-74f9-4dea-8286-96b7107fb5cc None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:30.324775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96142e06-74f9-4dea-8286-96b7107fb5cc None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:30.361865 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc872ff-1b68-4060-802a-f9706d8d14d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:30.362691 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc872ff-1b68-4060-802a-f9706d8d14d0 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:30.362975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc872ff-1b68-4060-802a-f9706d8d14d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:30.363243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc872ff-1b68-4060-802a-f9706d8d14d0 None admin] PATH_INFO: `/v3/projects/9e35a8b8c43f4b009077cedab6149e48` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:30.364461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc872ff-1b68-4060-802a-f9706d8d14d0 None admin] RBAC: Authorizing `identity:get_project(project_id=9e35a8b8c43f4b009077cedab6149e48)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:30.365890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc872ff-1b68-4060-802a-f9706d8d14d0 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:30.367615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 593/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Oct 28 19:41:30 2022] GET /identity/v3/projects/9e35a8b8c43f4b009077cedab6149e48 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:41:30.377642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be989b0b-2e6c-4422-addc-b0d7777e0dba None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:41:30.476466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be989b0b-2e6c-4422-addc-b0d7777e0dba None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:41:30.510183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a77d-6b05-4561-8b55-bf177dad2a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:41:30.510839 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a77d-6b05-4561-8b55-bf177dad2a10 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:41:30.511117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a77d-6b05-4561-8b55-bf177dad2a10 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:41:30.511390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a77d-6b05-4561-8b55-bf177dad2a10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:41:30.512214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a77d-6b05-4561-8b55-bf177dad2a10 None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=9e35a8b8c43f4b009077cedab6149e48, user.id=c25810152aa045f8b913bc513e9e85eb) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:41:30.512521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a77d-6b05-4561-8b55-bf177dad2a10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:41:30.513959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a77d-6b05-4561-8b55-bf177dad2a10 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:41:30.519822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 607/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:41:30 2022] GET /identity/v3/role_assignments?user.id=c25810152aa045f8b913bc513e9e85eb&scope.project.id=9e35a8b8c43f4b009077cedab6149e48&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:33.026123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2e42-bee8-4a40-a0cb-a1d66dc0a0b2 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:33.026774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2e42-bee8-4a40-a0cb-a1d66dc0a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:33.026774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2e42-bee8-4a40-a0cb-a1d66dc0a0b2 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:33.028511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 594/1201] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:33.034872 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78c2f7-5f42-4d2f-8cb6-bb1e0587695a None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:33.035747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78c2f7-5f42-4d2f-8cb6-bb1e0587695a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:33.035839 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78c2f7-5f42-4d2f-8cb6-bb1e0587695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:33.055716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0d78c2f7-5f42-4d2f-8cb6-bb1e0587695a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:33.056966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0d78c2f7-5f42-4d2f-8cb6-bb1e0587695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:33.131831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 608/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:42:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:42:33.163003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2e42-bee8-4a40-a0cb-a1d66dc0a0b2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:33.284276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2e42-bee8-4a40-a0cb-a1d66dc0a0b2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:33.324171 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0091088-fb5e-4fb6-b046-8c141b461cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:33.325337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0091088-fb5e-4fb6-b046-8c141b461cb5 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:33.325824 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0091088-fb5e-4fb6-b046-8c141b461cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:33.326358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0091088-fb5e-4fb6-b046-8c141b461cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:33.338959 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0091088-fb5e-4fb6-b046-8c141b461cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:33.341000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0091088-fb5e-4fb6-b046-8c141b461cb5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:33.360723 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-d0091088-fb5e-4fb6-b046-8c141b461cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:33.362372 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 595/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:33.369274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78c2f7-5f42-4d2f-8cb6-bb1e0587695a None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:33.490376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78c2f7-5f42-4d2f-8cb6-bb1e0587695a None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:33.531745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970d0b5-9ff4-4dce-af9a-27ae546ed299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:33.532733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970d0b5-9ff4-4dce-af9a-27ae546ed299 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:33.533174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970d0b5-9ff4-4dce-af9a-27ae546ed299 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:33.533558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970d0b5-9ff4-4dce-af9a-27ae546ed299 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:33.534534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970d0b5-9ff4-4dce-af9a-27ae546ed299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:33.534878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970d0b5-9ff4-4dce-af9a-27ae546ed299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:33.536908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970d0b5-9ff4-4dce-af9a-27ae546ed299 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:33.550199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 609/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:33.555900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0091088-fb5e-4fb6-b046-8c141b461cb5 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:33.677807 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0091088-fb5e-4fb6-b046-8c141b461cb5 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:33.725055 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdbd06-5358-4835-b6b5-9d0250b2d221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:33.725855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdbd06-5358-4835-b6b5-9d0250b2d221 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:33.726201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdbd06-5358-4835-b6b5-9d0250b2d221 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:33.729145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdbd06-5358-4835-b6b5-9d0250b2d221 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:33.729145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdbd06-5358-4835-b6b5-9d0250b2d221 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:33.729145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdbd06-5358-4835-b6b5-9d0250b2d221 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:33.762158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 596/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Oct 28 19:42:33 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:42:36.463890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf1726-71c4-456d-b48a-a5d44d8653ec None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:36.464616 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf1726-71c4-456d-b48a-a5d44d8653ec None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:36.464616 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf1726-71c4-456d-b48a-a5d44d8653ec None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:36.466689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 610/1206] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:36.473006 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ac2da-e909-433a-abdc-87d574fa36c7 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:36.473467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ac2da-e909-433a-abdc-87d574fa36c7 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:36.473723 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ac2da-e909-433a-abdc-87d574fa36c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:36.493993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-722ac2da-e909-433a-abdc-87d574fa36c7 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:36.495429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-722ac2da-e909-433a-abdc-87d574fa36c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:36.567993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 597/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:42:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:42:36.592072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf1726-71c4-456d-b48a-a5d44d8653ec None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:36.707715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf1726-71c4-456d-b48a-a5d44d8653ec None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:36.745337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbfb78-5064-4cef-95d3-c5078b369384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:36.746758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbfb78-5064-4cef-95d3-c5078b369384 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:36.747085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbfb78-5064-4cef-95d3-c5078b369384 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:36.747496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbfb78-5064-4cef-95d3-c5078b369384 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:36.763056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbfb78-5064-4cef-95d3-c5078b369384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:42:36.772843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-81bbfb78-5064-4cef-95d3-c5078b369384 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:42:36.779455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 611/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:42:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:36.782106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ac2da-e909-433a-abdc-87d574fa36c7 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:36.893101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ac2da-e909-433a-abdc-87d574fa36c7 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:36.931727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f611e83-c238-46e9-933a-187bdccef8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:36.932563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f611e83-c238-46e9-933a-187bdccef8a8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:36.933007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f611e83-c238-46e9-933a-187bdccef8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:36.933373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f611e83-c238-46e9-933a-187bdccef8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:36.934172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f611e83-c238-46e9-933a-187bdccef8a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:36.934507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f611e83-c238-46e9-933a-187bdccef8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:36.936103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f611e83-c238-46e9-933a-187bdccef8a8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:36.949960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 598/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:36.951172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbfb78-5064-4cef-95d3-c5078b369384 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:37.067334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbfb78-5064-4cef-95d3-c5078b369384 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:37.104128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3f5de-dc72-4331-b3ad-d038cd134d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:37.105151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3f5de-dc72-4331-b3ad-d038cd134d08 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:37.105388 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3f5de-dc72-4331-b3ad-d038cd134d08 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:37.105668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3f5de-dc72-4331-b3ad-d038cd134d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:37.119073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3f5de-dc72-4331-b3ad-d038cd134d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:37.120820 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3f5de-dc72-4331-b3ad-d038cd134d08 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:37.140384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-88a3f5de-dc72-4331-b3ad-d038cd134d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:37.142053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 612/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:37.147971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f611e83-c238-46e9-933a-187bdccef8a8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:37.255853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f611e83-c238-46e9-933a-187bdccef8a8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:37.290253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c02e9-cdb8-4fe0-8f91-cc7cbef5f661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:37.290983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c02e9-cdb8-4fe0-8f91-cc7cbef5f661 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:37.291358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c02e9-cdb8-4fe0-8f91-cc7cbef5f661 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:37.291642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c02e9-cdb8-4fe0-8f91-cc7cbef5f661 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:37.292410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c02e9-cdb8-4fe0-8f91-cc7cbef5f661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:37.292709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c02e9-cdb8-4fe0-8f91-cc7cbef5f661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:37.294151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c02e9-cdb8-4fe0-8f91-cc7cbef5f661 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:37.306706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 599/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:37.313029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3f5de-dc72-4331-b3ad-d038cd134d08 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:37.423676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3f5de-dc72-4331-b3ad-d038cd134d08 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:37.464376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cba5c-9669-4ebc-8152-0af6ea747b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:37.465214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cba5c-9669-4ebc-8152-0af6ea747b68 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:37.466757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cba5c-9669-4ebc-8152-0af6ea747b68 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:37.466757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cba5c-9669-4ebc-8152-0af6ea747b68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:37.474306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cba5c-9669-4ebc-8152-0af6ea747b68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:37.475929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cba5c-9669-4ebc-8152-0af6ea747b68 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:37.490907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-453cba5c-9669-4ebc-8152-0af6ea747b68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:42:37.492492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 613/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:37.498023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c02e9-cdb8-4fe0-8f91-cc7cbef5f661 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:37.603203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c02e9-cdb8-4fe0-8f91-cc7cbef5f661 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:37.644472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e1b26-5491-4e2f-a28e-e603416b8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:37.645285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e1b26-5491-4e2f-a28e-e603416b8736 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:37.645710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e1b26-5491-4e2f-a28e-e603416b8736 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:37.646034 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e1b26-5491-4e2f-a28e-e603416b8736 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:37.647101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e1b26-5491-4e2f-a28e-e603416b8736 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:37.647511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e1b26-5491-4e2f-a28e-e603416b8736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:37.649034 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e1b26-5491-4e2f-a28e-e603416b8736 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:37.671469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 600/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Oct 28 19:42:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:37.677493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cba5c-9669-4ebc-8152-0af6ea747b68 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:37.782283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cba5c-9669-4ebc-8152-0af6ea747b68 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:37.819777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8192f-db5e-4766-bb25-0ba8f760242d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:37.820441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8192f-db5e-4766-bb25-0ba8f760242d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:37.820738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8192f-db5e-4766-bb25-0ba8f760242d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:37.821053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8192f-db5e-4766-bb25-0ba8f760242d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:37.895337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8192f-db5e-4766-bb25-0ba8f760242d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:37.897078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8192f-db5e-4766-bb25-0ba8f760242d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:37.995420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 614/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:42:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 19:42:38.000158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e1b26-5491-4e2f-a28e-e603416b8736 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:38.104245 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e1b26-5491-4e2f-a28e-e603416b8736 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:38.137461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c914fc0-aa41-4816-af7f-89164d77dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:38.138565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c914fc0-aa41-4816-af7f-89164d77dd1c None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:38.138846 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c914fc0-aa41-4816-af7f-89164d77dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:38.139114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c914fc0-aa41-4816-af7f-89164d77dd1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:38.148836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c914fc0-aa41-4816-af7f-89164d77dd1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:38.150344 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c914fc0-aa41-4816-af7f-89164d77dd1c None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:38.168287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-4c914fc0-aa41-4816-af7f-89164d77dd1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:38.169505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 601/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:42:38.175329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8192f-db5e-4766-bb25-0ba8f760242d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:38.280319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8192f-db5e-4766-bb25-0ba8f760242d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:38.317848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4576-10e9-47c9-a339-6dfb7e878546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:38.318559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4576-10e9-47c9-a339-6dfb7e878546 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:38.318892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4576-10e9-47c9-a339-6dfb7e878546 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:38.319200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4576-10e9-47c9-a339-6dfb7e878546 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:38.319879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b4576-10e9-47c9-a339-6dfb7e878546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:38.320158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b4576-10e9-47c9-a339-6dfb7e878546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:38.321544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b4576-10e9-47c9-a339-6dfb7e878546 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:38.332871 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 615/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:38.338729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c914fc0-aa41-4816-af7f-89164d77dd1c None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:38.445674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c914fc0-aa41-4816-af7f-89164d77dd1c None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:38.481223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787d59a-78e6-4ff3-9c13-c94bb9b7019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:38.482034 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787d59a-78e6-4ff3-9c13-c94bb9b7019d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:38.482359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787d59a-78e6-4ff3-9c13-c94bb9b7019d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:38.482673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787d59a-78e6-4ff3-9c13-c94bb9b7019d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:38.490225 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787d59a-78e6-4ff3-9c13-c94bb9b7019d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:38.492367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787d59a-78e6-4ff3-9c13-c94bb9b7019d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:38.507794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-7787d59a-78e6-4ff3-9c13-c94bb9b7019d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:42:38.509046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 602/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:38.515151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4576-10e9-47c9-a339-6dfb7e878546 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:38.624602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4576-10e9-47c9-a339-6dfb7e878546 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:38.663173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea61830-3691-4a58-bf84-ff009e3bcdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:38.663846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea61830-3691-4a58-bf84-ff009e3bcdc2 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:38.664178 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea61830-3691-4a58-bf84-ff009e3bcdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:38.664394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea61830-3691-4a58-bf84-ff009e3bcdc2 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:38.665193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea61830-3691-4a58-bf84-ff009e3bcdc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:38.665499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea61830-3691-4a58-bf84-ff009e3bcdc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:38.667006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea61830-3691-4a58-bf84-ff009e3bcdc2 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:38.680882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 616/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:38.687023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787d59a-78e6-4ff3-9c13-c94bb9b7019d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:38.796996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787d59a-78e6-4ff3-9c13-c94bb9b7019d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:38.832049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b131460-7390-4c39-9648-e212cff8ecb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:38.832720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131460-7390-4c39-9648-e212cff8ecb2 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:38.833008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131460-7390-4c39-9648-e212cff8ecb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:38.833274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131460-7390-4c39-9648-e212cff8ecb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:38.834129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b131460-7390-4c39-9648-e212cff8ecb2 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=4e04cc7f60894946aace79d4c2875f53) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:38.834444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b131460-7390-4c39-9648-e212cff8ecb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:38.835913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b131460-7390-4c39-9648-e212cff8ecb2 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:38.841770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 603/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:42:38 2022] GET /identity/v3/role_assignments?user.id=4e04cc7f60894946aace79d4c2875f53&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:41.183336 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2e3bb-63b0-496c-91ce-8553fc152a42 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.183927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2e3bb-63b0-496c-91ce-8553fc152a42 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.183927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2e3bb-63b0-496c-91ce-8553fc152a42 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.186836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 617/1220] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:42:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:42:41.192231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560f2fd-896a-4b29-af6f-2a58d46ebd39 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.192635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560f2fd-896a-4b29-af6f-2a58d46ebd39 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.192790 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560f2fd-896a-4b29-af6f-2a58d46ebd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.211454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1560f2fd-896a-4b29-af6f-2a58d46ebd39 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:41.212802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1560f2fd-896a-4b29-af6f-2a58d46ebd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:41.284758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 604/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:42:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:42:41.310792 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2e3bb-63b0-496c-91ce-8553fc152a42 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:41.418544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2e3bb-63b0-496c-91ce-8553fc152a42 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:41.457296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494d78e-8691-43c9-b2de-313607da0a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:41.458068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494d78e-8691-43c9-b2de-313607da0a97 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.458378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494d78e-8691-43c9-b2de-313607da0a97 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.458650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494d78e-8691-43c9-b2de-313607da0a97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.469570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494d78e-8691-43c9-b2de-313607da0a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:42:41.476931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-2494d78e-8691-43c9-b2de-313607da0a97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:42:41.478348 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 618/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:42:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:42:41.485221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560f2fd-896a-4b29-af6f-2a58d46ebd39 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:41.593541 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560f2fd-896a-4b29-af6f-2a58d46ebd39 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:41.629072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f2d9d-9c43-4d7a-9518-f24ce59a6fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:41.629757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f2d9d-9c43-4d7a-9518-f24ce59a6fb8 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.630036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f2d9d-9c43-4d7a-9518-f24ce59a6fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.630337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f2d9d-9c43-4d7a-9518-f24ce59a6fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.631131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f2d9d-9c43-4d7a-9518-f24ce59a6fb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:41.631539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f2d9d-9c43-4d7a-9518-f24ce59a6fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:41.632971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f2d9d-9c43-4d7a-9518-f24ce59a6fb8 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:41.641805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 605/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:42:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:41.648004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494d78e-8691-43c9-b2de-313607da0a97 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:41.770486 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494d78e-8691-43c9-b2de-313607da0a97 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:41.810424 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5e07-672d-44d9-bdf6-d39976267925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:41.811245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5e07-672d-44d9-bdf6-d39976267925 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.811537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5e07-672d-44d9-bdf6-d39976267925 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.811877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5e07-672d-44d9-bdf6-d39976267925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.823642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c5e07-672d-44d9-bdf6-d39976267925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:41.825225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c5e07-672d-44d9-bdf6-d39976267925 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:41.843699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-a40c5e07-672d-44d9-bdf6-d39976267925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:41.845014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 619/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:42:41.851141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f2d9d-9c43-4d7a-9518-f24ce59a6fb8 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:41.956669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f2d9d-9c43-4d7a-9518-f24ce59a6fb8 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:41.990041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5518-e843-4b78-8348-8564d25ebc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:41.990996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5518-e843-4b78-8348-8564d25ebc5e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.991270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5518-e843-4b78-8348-8564d25ebc5e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.991591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5518-e843-4b78-8348-8564d25ebc5e None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.992567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5518-e843-4b78-8348-8564d25ebc5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:41.992951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5518-e843-4b78-8348-8564d25ebc5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:41.994511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5518-e843-4b78-8348-8564d25ebc5e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.007815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 606/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:42.013884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5e07-672d-44d9-bdf6-d39976267925 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:42.120324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5e07-672d-44d9-bdf6-d39976267925 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.153339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7baddb-1212-4e6c-a791-bbfec38382ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.154361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7baddb-1212-4e6c-a791-bbfec38382ea None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.154733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7baddb-1212-4e6c-a791-bbfec38382ea None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.155019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7baddb-1212-4e6c-a791-bbfec38382ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.164137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7baddb-1212-4e6c-a791-bbfec38382ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.165617 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7baddb-1212-4e6c-a791-bbfec38382ea None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.179469 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-ba7baddb-1212-4e6c-a791-bbfec38382ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:42:42.182111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 620/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:42:42.186750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5518-e843-4b78-8348-8564d25ebc5e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:42.289595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5518-e843-4b78-8348-8564d25ebc5e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.325269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302f7a2-934e-4a2c-a90d-aeb62e751b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.326229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302f7a2-934e-4a2c-a90d-aeb62e751b9d None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.326579 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302f7a2-934e-4a2c-a90d-aeb62e751b9d None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.327004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302f7a2-934e-4a2c-a90d-aeb62e751b9d None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.328089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302f7a2-934e-4a2c-a90d-aeb62e751b9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:42.328589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302f7a2-934e-4a2c-a90d-aeb62e751b9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.330470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302f7a2-934e-4a2c-a90d-aeb62e751b9d None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.350036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 607/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Oct 28 19:42:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:42.356401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7baddb-1212-4e6c-a791-bbfec38382ea None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:42.462832 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7baddb-1212-4e6c-a791-bbfec38382ea None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.494815 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deadff-b290-49b1-81bb-06c645b38a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.495701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deadff-b290-49b1-81bb-06c645b38a76 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.495979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deadff-b290-49b1-81bb-06c645b38a76 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.496250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deadff-b290-49b1-81bb-06c645b38a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.508010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deadff-b290-49b1-81bb-06c645b38a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.509607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deadff-b290-49b1-81bb-06c645b38a76 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.526926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-12deadff-b290-49b1-81bb-06c645b38a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:42.529458 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 621/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:42.534497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302f7a2-934e-4a2c-a90d-aeb62e751b9d None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:42.638444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302f7a2-934e-4a2c-a90d-aeb62e751b9d None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.674660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bf5b6-9018-4a15-a315-d7137b377a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.675338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bf5b6-9018-4a15-a315-d7137b377a41 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.675619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bf5b6-9018-4a15-a315-d7137b377a41 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.675890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bf5b6-9018-4a15-a315-d7137b377a41 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.676679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bf5b6-9018-4a15-a315-d7137b377a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:42.677005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bf5b6-9018-4a15-a315-d7137b377a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.678593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bf5b6-9018-4a15-a315-d7137b377a41 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.690417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 608/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:42.696510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deadff-b290-49b1-81bb-06c645b38a76 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:42.804441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deadff-b290-49b1-81bb-06c645b38a76 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.837136 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e014b4-35ce-462e-9b95-d1d3246a3a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.837942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e014b4-35ce-462e-9b95-d1d3246a3a81 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.838241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e014b4-35ce-462e-9b95-d1d3246a3a81 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.838511 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e014b4-35ce-462e-9b95-d1d3246a3a81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.844923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e014b4-35ce-462e-9b95-d1d3246a3a81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.846405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e014b4-35ce-462e-9b95-d1d3246a3a81 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.859509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-c4e014b4-35ce-462e-9b95-d1d3246a3a81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:42:42.860688 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 622/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:42:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:42.866825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bf5b6-9018-4a15-a315-d7137b377a41 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:42.977544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bf5b6-9018-4a15-a315-d7137b377a41 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:43.012143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f39c7b-598a-4123-aeb1-ef03c34814ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:43.012786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f39c7b-598a-4123-aeb1-ef03c34814ce None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:43.013090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f39c7b-598a-4123-aeb1-ef03c34814ce None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:43.013361 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f39c7b-598a-4123-aeb1-ef03c34814ce None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:43.014142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f39c7b-598a-4123-aeb1-ef03c34814ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:43.014489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f39c7b-598a-4123-aeb1-ef03c34814ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:43.015904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f39c7b-598a-4123-aeb1-ef03c34814ce None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:43.027808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 609/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:43.033901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e014b4-35ce-462e-9b95-d1d3246a3a81 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:43.133875 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e014b4-35ce-462e-9b95-d1d3246a3a81 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:43.168480 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250641f-ff5c-4a92-ba52-24d73ad311c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:43.169390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250641f-ff5c-4a92-ba52-24d73ad311c8 None admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:43.169677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250641f-ff5c-4a92-ba52-24d73ad311c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:43.169950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250641f-ff5c-4a92-ba52-24d73ad311c8 None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/4e04cc7f60894946aace79d4c2875f53/roles/143037337c76416d8ad332410c456159` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:43.185403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250641f-ff5c-4a92-ba52-24d73ad311c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=4e04cc7f60894946aace79d4c2875f53, role_id=143037337c76416d8ad332410c456159)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:43.187105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250641f-ff5c-4a92-ba52-24d73ad311c8 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:43.202502 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 623/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:42:43 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/4e04cc7f60894946aace79d4c2875f53/roles/143037337c76416d8ad332410c456159 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:42:45.767994 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2a92-f5ec-4203-966a-48f3cad2b880 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:45.768562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2a92-f5ec-4203-966a-48f3cad2b880 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:45.768562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2a92-f5ec-4203-966a-48f3cad2b880 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:45.770928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 610/1233] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:42:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:45.777639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ec94f-c1d4-4b2c-a634-6ebaf58bb5d8 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:45.778129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ec94f-c1d4-4b2c-a634-6ebaf58bb5d8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:45.778390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ec94f-c1d4-4b2c-a634-6ebaf58bb5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:45.800591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-a90ec94f-c1d4-4b2c-a634-6ebaf58bb5d8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:45.802334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-a90ec94f-c1d4-4b2c-a634-6ebaf58bb5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:45.875458 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 624/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:42:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:42:45.900670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2a92-f5ec-4203-966a-48f3cad2b880 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:46.010792 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2a92-f5ec-4203-966a-48f3cad2b880 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:46.049345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c6989-78c7-42c2-8f05-ac6d615b8d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:46.050177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c6989-78c7-42c2-8f05-ac6d615b8d41 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.050457 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c6989-78c7-42c2-8f05-ac6d615b8d41 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.050721 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c6989-78c7-42c2-8f05-ac6d615b8d41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.062008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c6989-78c7-42c2-8f05-ac6d615b8d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:42:46.070488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-fa5c6989-78c7-42c2-8f05-ac6d615b8d41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:42:46.072071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 611/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Oct 28 19:42:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:46.079550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ec94f-c1d4-4b2c-a634-6ebaf58bb5d8 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:46.186140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ec94f-c1d4-4b2c-a634-6ebaf58bb5d8 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:46.218747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58b450-59c3-4745-8815-34b59d3023f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:46.219376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58b450-59c3-4745-8815-34b59d3023f4 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.219645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58b450-59c3-4745-8815-34b59d3023f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.219951 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58b450-59c3-4745-8815-34b59d3023f4 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.220679 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58b450-59c3-4745-8815-34b59d3023f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:46.221030 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58b450-59c3-4745-8815-34b59d3023f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:46.222597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58b450-59c3-4745-8815-34b59d3023f4 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:46.232690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 625/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Oct 28 19:42:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:46.239224 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c6989-78c7-42c2-8f05-ac6d615b8d41 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:46.348349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c6989-78c7-42c2-8f05-ac6d615b8d41 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:46.384043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c71719-6d8f-43af-b8a8-bd1d28de0aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:46.384929 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c71719-6d8f-43af-b8a8-bd1d28de0aba None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.385214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c71719-6d8f-43af-b8a8-bd1d28de0aba None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.385494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c71719-6d8f-43af-b8a8-bd1d28de0aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.396689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c71719-6d8f-43af-b8a8-bd1d28de0aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:46.398313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c71719-6d8f-43af-b8a8-bd1d28de0aba None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:46.418714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a6c71719-6d8f-43af-b8a8-bd1d28de0aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:46.420174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 612/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:46.426187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58b450-59c3-4745-8815-34b59d3023f4 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:46.535645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58b450-59c3-4745-8815-34b59d3023f4 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:46.572311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccce542-a508-4522-92b0-76fb895110f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:46.573057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce542-a508-4522-92b0-76fb895110f0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.573335 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce542-a508-4522-92b0-76fb895110f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.573602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce542-a508-4522-92b0-76fb895110f0 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.574411 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccce542-a508-4522-92b0-76fb895110f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:46.574712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccce542-a508-4522-92b0-76fb895110f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:46.576275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccce542-a508-4522-92b0-76fb895110f0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:46.588982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 626/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:46.595177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c71719-6d8f-43af-b8a8-bd1d28de0aba None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:46.702019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c71719-6d8f-43af-b8a8-bd1d28de0aba None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:46.741106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285cdf6-5ddb-4f02-8988-d4533adbc6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:46.742155 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285cdf6-5ddb-4f02-8988-d4533adbc6e6 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.742376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285cdf6-5ddb-4f02-8988-d4533adbc6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.742647 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285cdf6-5ddb-4f02-8988-d4533adbc6e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.751634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285cdf6-5ddb-4f02-8988-d4533adbc6e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:46.753350 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285cdf6-5ddb-4f02-8988-d4533adbc6e6 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:46.769119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-c285cdf6-5ddb-4f02-8988-d4533adbc6e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:42:46.770446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 613/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:42:46.777025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccce542-a508-4522-92b0-76fb895110f0 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:46.881212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccce542-a508-4522-92b0-76fb895110f0 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:46.916126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35282c-01c2-48f5-ba8f-29654124a590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:46.916816 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35282c-01c2-48f5-ba8f-29654124a590 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.917098 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35282c-01c2-48f5-ba8f-29654124a590 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.917366 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35282c-01c2-48f5-ba8f-29654124a590 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.918240 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35282c-01c2-48f5-ba8f-29654124a590 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:46.918547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35282c-01c2-48f5-ba8f-29654124a590 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:46.920031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35282c-01c2-48f5-ba8f-29654124a590 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:46.938334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 627/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Oct 28 19:42:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:46.944230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285cdf6-5ddb-4f02-8988-d4533adbc6e6 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:47.045695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285cdf6-5ddb-4f02-8988-d4533adbc6e6 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:47.079781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2eb37-a3cb-4f32-ae80-3c28a8112107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:47.080574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2eb37-a3cb-4f32-ae80-3c28a8112107 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.080861 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2eb37-a3cb-4f32-ae80-3c28a8112107 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.081130 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2eb37-a3cb-4f32-ae80-3c28a8112107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.154135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2eb37-a3cb-4f32-ae80-3c28a8112107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:47.155646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2eb37-a3cb-4f32-ae80-3c28a8112107 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:47.262027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 614/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:42:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:42:47.268253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35282c-01c2-48f5-ba8f-29654124a590 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:47.371418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35282c-01c2-48f5-ba8f-29654124a590 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:47.406468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d372c4-44d7-4bef-acff-a847450c220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:47.407526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d372c4-44d7-4bef-acff-a847450c220e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.407960 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d372c4-44d7-4bef-acff-a847450c220e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.408376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d372c4-44d7-4bef-acff-a847450c220e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.420405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d372c4-44d7-4bef-acff-a847450c220e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:47.422037 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d372c4-44d7-4bef-acff-a847450c220e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:47.439351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-34d372c4-44d7-4bef-acff-a847450c220e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:47.440554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 628/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:47.446490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2eb37-a3cb-4f32-ae80-3c28a8112107 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:47.548030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2eb37-a3cb-4f32-ae80-3c28a8112107 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:47.589084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe584e2-d463-41ec-bda9-0582f15d5000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:47.589901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe584e2-d463-41ec-bda9-0582f15d5000 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.590311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe584e2-d463-41ec-bda9-0582f15d5000 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.590668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe584e2-d463-41ec-bda9-0582f15d5000 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.591511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe584e2-d463-41ec-bda9-0582f15d5000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:47.591895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe584e2-d463-41ec-bda9-0582f15d5000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:47.593485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe584e2-d463-41ec-bda9-0582f15d5000 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:47.608733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 615/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:47.615604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d372c4-44d7-4bef-acff-a847450c220e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:47.722718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d372c4-44d7-4bef-acff-a847450c220e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:47.759429 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19445e03-79c6-4fca-92bf-538ad3f4bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:47.760331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445e03-79c6-4fca-92bf-538ad3f4bf80 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.760706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445e03-79c6-4fca-92bf-538ad3f4bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.761000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445e03-79c6-4fca-92bf-538ad3f4bf80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.769655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19445e03-79c6-4fca-92bf-538ad3f4bf80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:47.771179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19445e03-79c6-4fca-92bf-538ad3f4bf80 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:47.786865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-19445e03-79c6-4fca-92bf-538ad3f4bf80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:42:47.788376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 629/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:42:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:47.794685 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe584e2-d463-41ec-bda9-0582f15d5000 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:47.896376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe584e2-d463-41ec-bda9-0582f15d5000 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:47.931531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d84a38-2b9f-4c5d-b303-c83ca6279a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:47.932210 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d84a38-2b9f-4c5d-b303-c83ca6279a76 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.932486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d84a38-2b9f-4c5d-b303-c83ca6279a76 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.932748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d84a38-2b9f-4c5d-b303-c83ca6279a76 None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.933530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d84a38-2b9f-4c5d-b303-c83ca6279a76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:47.933834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d84a38-2b9f-4c5d-b303-c83ca6279a76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:47.935308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d84a38-2b9f-4c5d-b303-c83ca6279a76 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:47.954013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 616/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:42:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:47.955197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19445e03-79c6-4fca-92bf-538ad3f4bf80 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:48.057907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19445e03-79c6-4fca-92bf-538ad3f4bf80 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:48.092520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae30c8-c314-4b44-bf84-2c5a04442013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:48.093239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae30c8-c314-4b44-bf84-2c5a04442013 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:48.093552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae30c8-c314-4b44-bf84-2c5a04442013 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:48.093848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae30c8-c314-4b44-bf84-2c5a04442013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:48.094766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae30c8-c314-4b44-bf84-2c5a04442013 None admin] RBAC: Adding query filter params (role.id=143037337c76416d8ad332410c456159, scope.project.id=e91226b635934bfcb949577491791af4, user.id=4e04cc7f60894946aace79d4c2875f53) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:48.095074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae30c8-c314-4b44-bf84-2c5a04442013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:48.096629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae30c8-c314-4b44-bf84-2c5a04442013 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:48.103208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 630/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:42:47 2022] GET /identity/v3/role_assignments?user.id=4e04cc7f60894946aace79d4c2875f53&scope.project.id=e91226b635934bfcb949577491791af4&role.id=143037337c76416d8ad332410c456159 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:50.558781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13569239-630a-4ee1-95fb-5bf2d090121b None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:50.559343 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13569239-630a-4ee1-95fb-5bf2d090121b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:50.559343 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13569239-630a-4ee1-95fb-5bf2d090121b None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:50.561082 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 617/1247] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:50.566691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d423707-d4ad-4aea-9e3b-87774f6592e6 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:50.567118 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d423707-d4ad-4aea-9e3b-87774f6592e6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:50.567231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d423707-d4ad-4aea-9e3b-87774f6592e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:50.586100 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-9d423707-d4ad-4aea-9e3b-87774f6592e6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:50.587967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9d423707-d4ad-4aea-9e3b-87774f6592e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:50.667194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 631/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:42:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:42:50.691376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13569239-630a-4ee1-95fb-5bf2d090121b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:50.801965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13569239-630a-4ee1-95fb-5bf2d090121b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:50.839581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d47853-1c0c-4015-a68b-f0370cecb36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:50.840310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d47853-1c0c-4015-a68b-f0370cecb36f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:50.840593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d47853-1c0c-4015-a68b-f0370cecb36f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:50.840849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d47853-1c0c-4015-a68b-f0370cecb36f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:50.851757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d47853-1c0c-4015-a68b-f0370cecb36f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:42:50.858625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-b1d47853-1c0c-4015-a68b-f0370cecb36f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:42:50.859824 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 618/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:50.865974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d423707-d4ad-4aea-9e3b-87774f6592e6 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:50.972126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d423707-d4ad-4aea-9e3b-87774f6592e6 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:51.006813 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd931b8-2fca-4f02-9dcc-7ed9f91e2004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:51.007453 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd931b8-2fca-4f02-9dcc-7ed9f91e2004 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:51.007749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd931b8-2fca-4f02-9dcc-7ed9f91e2004 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:51.008031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd931b8-2fca-4f02-9dcc-7ed9f91e2004 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:51.008785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd931b8-2fca-4f02-9dcc-7ed9f91e2004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:51.009088 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd931b8-2fca-4f02-9dcc-7ed9f91e2004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:51.010543 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd931b8-2fca-4f02-9dcc-7ed9f91e2004 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:51.019652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 632/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:51.025873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d47853-1c0c-4015-a68b-f0370cecb36f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:51.140123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d47853-1c0c-4015-a68b-f0370cecb36f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:51.176197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab740c7-5694-4fe5-870c-9ac0a18f8fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:51.177119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab740c7-5694-4fe5-870c-9ac0a18f8fa4 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:51.177522 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab740c7-5694-4fe5-870c-9ac0a18f8fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:51.177732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab740c7-5694-4fe5-870c-9ac0a18f8fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:51.189833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab740c7-5694-4fe5-870c-9ac0a18f8fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:51.191580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab740c7-5694-4fe5-870c-9ac0a18f8fa4 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:51.209324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-3ab740c7-5694-4fe5-870c-9ac0a18f8fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:51.210868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 619/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:51.216682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd931b8-2fca-4f02-9dcc-7ed9f91e2004 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:51.326196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd931b8-2fca-4f02-9dcc-7ed9f91e2004 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:51.362380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63b18-1edd-4225-8c63-bd46837f9109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:51.363244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63b18-1edd-4225-8c63-bd46837f9109 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:51.363551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63b18-1edd-4225-8c63-bd46837f9109 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:51.363820 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63b18-1edd-4225-8c63-bd46837f9109 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:51.364690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a63b18-1edd-4225-8c63-bd46837f9109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:51.364963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a63b18-1edd-4225-8c63-bd46837f9109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:51.366649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a63b18-1edd-4225-8c63-bd46837f9109 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:51.381477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 633/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:51.387366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab740c7-5694-4fe5-870c-9ac0a18f8fa4 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:51.495532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab740c7-5694-4fe5-870c-9ac0a18f8fa4 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:51.532488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ee93f-aeb1-4095-9808-3a2ce0da6bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:51.533317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ee93f-aeb1-4095-9808-3a2ce0da6bdb None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:51.533595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ee93f-aeb1-4095-9808-3a2ce0da6bdb None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:51.533865 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ee93f-aeb1-4095-9808-3a2ce0da6bdb None admin] PATH_INFO: `/v3/users/placement` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:51.543527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ee93f-aeb1-4095-9808-3a2ce0da6bdb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:51.545004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ee93f-aeb1-4095-9808-3a2ce0da6bdb None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:51.560089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-467ee93f-aeb1-4095-9808-3a2ce0da6bdb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:42:51.561374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 620/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:51.567564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63b18-1edd-4225-8c63-bd46837f9109 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:51.680227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63b18-1edd-4225-8c63-bd46837f9109 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:51.718616 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e275d-1a3b-49ee-9bda-682d8dff3f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:51.719302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e275d-1a3b-49ee-9bda-682d8dff3f17 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:51.719586 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e275d-1a3b-49ee-9bda-682d8dff3f17 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:51.719855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e275d-1a3b-49ee-9bda-682d8dff3f17 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:51.720761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e275d-1a3b-49ee-9bda-682d8dff3f17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:51.721070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e275d-1a3b-49ee-9bda-682d8dff3f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:51.722574 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e275d-1a3b-49ee-9bda-682d8dff3f17 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:51.742319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 634/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Oct 28 19:42:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:51.749274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ee93f-aeb1-4095-9808-3a2ce0da6bdb None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:51.867439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ee93f-aeb1-4095-9808-3a2ce0da6bdb None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:51.901671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be144ee6-2f5e-4180-8a02-898f338d263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:51.902400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be144ee6-2f5e-4180-8a02-898f338d263a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:51.902675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be144ee6-2f5e-4180-8a02-898f338d263a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:51.902934 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be144ee6-2f5e-4180-8a02-898f338d263a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:51.969026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be144ee6-2f5e-4180-8a02-898f338d263a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:51.970568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be144ee6-2f5e-4180-8a02-898f338d263a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:52.069098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 621/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:42:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:42:52.077803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e275d-1a3b-49ee-9bda-682d8dff3f17 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:52.177972 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e275d-1a3b-49ee-9bda-682d8dff3f17 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:52.211843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b7eb2-6e2f-4ebf-afeb-0335868a9c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:52.212647 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b7eb2-6e2f-4ebf-afeb-0335868a9c04 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:52.212934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b7eb2-6e2f-4ebf-afeb-0335868a9c04 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:52.213204 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b7eb2-6e2f-4ebf-afeb-0335868a9c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:52.223296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b7eb2-6e2f-4ebf-afeb-0335868a9c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:52.224747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b7eb2-6e2f-4ebf-afeb-0335868a9c04 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:52.241637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-062b7eb2-6e2f-4ebf-afeb-0335868a9c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:52.242797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 635/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:42:52.248880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be144ee6-2f5e-4180-8a02-898f338d263a None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:52.360307 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be144ee6-2f5e-4180-8a02-898f338d263a None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:52.395238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc85b55-0576-4773-bbbf-667dd61e3b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:52.395890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc85b55-0576-4773-bbbf-667dd61e3b12 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:52.396169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc85b55-0576-4773-bbbf-667dd61e3b12 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:52.396446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc85b55-0576-4773-bbbf-667dd61e3b12 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:52.397258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc85b55-0576-4773-bbbf-667dd61e3b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:52.397567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc85b55-0576-4773-bbbf-667dd61e3b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:52.398994 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc85b55-0576-4773-bbbf-667dd61e3b12 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:52.410429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 622/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:52.416201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b7eb2-6e2f-4ebf-afeb-0335868a9c04 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:52.517749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b7eb2-6e2f-4ebf-afeb-0335868a9c04 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:52.553633 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c769b-594e-4e7b-b2f5-3c3f091e3a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:52.554436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c769b-594e-4e7b-b2f5-3c3f091e3a47 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:52.554716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c769b-594e-4e7b-b2f5-3c3f091e3a47 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:52.554989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c769b-594e-4e7b-b2f5-3c3f091e3a47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:52.561895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c769b-594e-4e7b-b2f5-3c3f091e3a47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:52.563383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c769b-594e-4e7b-b2f5-3c3f091e3a47 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:52.576516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-3a8c769b-594e-4e7b-b2f5-3c3f091e3a47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:42:52.577643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 636/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:52.584348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc85b55-0576-4773-bbbf-667dd61e3b12 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:52.699493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc85b55-0576-4773-bbbf-667dd61e3b12 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:52.732510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65407e-f2ae-47c7-9b36-bd8b8e38637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:52.733156 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65407e-f2ae-47c7-9b36-bd8b8e38637e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:52.733443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65407e-f2ae-47c7-9b36-bd8b8e38637e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:52.733710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65407e-f2ae-47c7-9b36-bd8b8e38637e None admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:52.734519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65407e-f2ae-47c7-9b36-bd8b8e38637e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:52.734841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65407e-f2ae-47c7-9b36-bd8b8e38637e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:52.736259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65407e-f2ae-47c7-9b36-bd8b8e38637e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:52.748941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 623/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:52.755722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c769b-594e-4e7b-b2f5-3c3f091e3a47 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:52.862799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c769b-594e-4e7b-b2f5-3c3f091e3a47 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:52.896139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1e734-5d02-4445-925a-cdc5d7cd0496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:52.896721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e734-5d02-4445-925a-cdc5d7cd0496 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:52.897027 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e734-5d02-4445-925a-cdc5d7cd0496 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:52.897300 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e734-5d02-4445-925a-cdc5d7cd0496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:52.898181 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1e734-5d02-4445-925a-cdc5d7cd0496 None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=e91226b635934bfcb949577491791af4, user.id=4e04cc7f60894946aace79d4c2875f53) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:52.898482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1e734-5d02-4445-925a-cdc5d7cd0496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:52.899922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1e734-5d02-4445-925a-cdc5d7cd0496 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:52.905265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 637/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:42:52 2022] GET /identity/v3/role_assignments?user.id=4e04cc7f60894946aace79d4c2875f53&scope.project.id=e91226b635934bfcb949577491791af4&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:55.201560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203bf5f-51b8-412d-bc14-f6e40c53c58a None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:55.202466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203bf5f-51b8-412d-bc14-f6e40c53c58a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:55.202466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203bf5f-51b8-412d-bc14-f6e40c53c58a None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:55.205297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 624/1261] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:42:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:55.210833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cca7e-13d5-43ed-b4ee-18ca7033a945 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:55.211244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cca7e-13d5-43ed-b4ee-18ca7033a945 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:55.211332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cca7e-13d5-43ed-b4ee-18ca7033a945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:55.233222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-5b0cca7e-13d5-43ed-b4ee-18ca7033a945 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:55.234463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5b0cca7e-13d5-43ed-b4ee-18ca7033a945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:55.299235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 638/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:42:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:42:55.322498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203bf5f-51b8-412d-bc14-f6e40c53c58a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:55.437066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203bf5f-51b8-412d-bc14-f6e40c53c58a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:55.471208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266fd81-be64-45d7-996f-665874f164c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:55.471930 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266fd81-be64-45d7-996f-665874f164c3 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:55.472214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266fd81-be64-45d7-996f-665874f164c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:55.472484 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266fd81-be64-45d7-996f-665874f164c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:55.484128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266fd81-be64-45d7-996f-665874f164c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:42:55.491156 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-f266fd81-be64-45d7-996f-665874f164c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:42:55.492356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 625/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:55.498859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cca7e-13d5-43ed-b4ee-18ca7033a945 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:55.607828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cca7e-13d5-43ed-b4ee-18ca7033a945 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:55.643412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581a36b-3ad6-4504-a80f-06d9980d0968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:55.643808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581a36b-3ad6-4504-a80f-06d9980d0968 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:55.644085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581a36b-3ad6-4504-a80f-06d9980d0968 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:55.644361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581a36b-3ad6-4504-a80f-06d9980d0968 None admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:55.645113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581a36b-3ad6-4504-a80f-06d9980d0968 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:55.645415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581a36b-3ad6-4504-a80f-06d9980d0968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:55.646957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581a36b-3ad6-4504-a80f-06d9980d0968 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:55.655447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 639/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:55.661697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266fd81-be64-45d7-996f-665874f164c3 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:55.781783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266fd81-be64-45d7-996f-665874f164c3 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:55.825308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f69a0e-adfa-43dc-baf2-6c15147139ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:55.826511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69a0e-adfa-43dc-baf2-6c15147139ad None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:55.826829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69a0e-adfa-43dc-baf2-6c15147139ad None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:55.827104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69a0e-adfa-43dc-baf2-6c15147139ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:55.839042 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f69a0e-adfa-43dc-baf2-6c15147139ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:55.840658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f69a0e-adfa-43dc-baf2-6c15147139ad None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:55.859466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a6f69a0e-adfa-43dc-baf2-6c15147139ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:55.860673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 626/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:55.866864 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581a36b-3ad6-4504-a80f-06d9980d0968 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:55.969534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581a36b-3ad6-4504-a80f-06d9980d0968 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:56.015940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782173f2-9429-4df0-a678-1e7168956476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:56.016596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782173f2-9429-4df0-a678-1e7168956476 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:56.016876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782173f2-9429-4df0-a678-1e7168956476 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:56.017151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782173f2-9429-4df0-a678-1e7168956476 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:56.017880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782173f2-9429-4df0-a678-1e7168956476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:56.018224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782173f2-9429-4df0-a678-1e7168956476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:56.019610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782173f2-9429-4df0-a678-1e7168956476 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:56.031280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 640/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:56.038220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f69a0e-adfa-43dc-baf2-6c15147139ad None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:56.150253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f69a0e-adfa-43dc-baf2-6c15147139ad None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:56.184067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027424e4-5492-4490-becc-f8d38bb97cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:56.184853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027424e4-5492-4490-becc-f8d38bb97cf1 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:56.185129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027424e4-5492-4490-becc-f8d38bb97cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:56.185400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027424e4-5492-4490-becc-f8d38bb97cf1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:56.192846 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027424e4-5492-4490-becc-f8d38bb97cf1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:56.194329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027424e4-5492-4490-becc-f8d38bb97cf1 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:56.207804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-027424e4-5492-4490-becc-f8d38bb97cf1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:42:56.208936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 627/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:56.215331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782173f2-9429-4df0-a678-1e7168956476 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:56.318431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782173f2-9429-4df0-a678-1e7168956476 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:56.352551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805f07b-ca09-4fa5-adfb-be7b655ca760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:56.353229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805f07b-ca09-4fa5-adfb-be7b655ca760 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:56.353504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805f07b-ca09-4fa5-adfb-be7b655ca760 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:56.353767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805f07b-ca09-4fa5-adfb-be7b655ca760 None admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:56.354630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805f07b-ca09-4fa5-adfb-be7b655ca760 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:56.354931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805f07b-ca09-4fa5-adfb-be7b655ca760 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:56.356351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805f07b-ca09-4fa5-adfb-be7b655ca760 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:56.374073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 641/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Oct 28 19:42:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:56.380559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027424e4-5492-4490-becc-f8d38bb97cf1 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:56.489808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027424e4-5492-4490-becc-f8d38bb97cf1 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:56.524953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3a09-05f4-497b-ace5-0126c54d004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:56.526170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3a09-05f4-497b-ace5-0126c54d004f None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:56.526556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3a09-05f4-497b-ace5-0126c54d004f None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:56.526954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3a09-05f4-497b-ace5-0126c54d004f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:56.543283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e3a09-05f4-497b-ace5-0126c54d004f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:56.544734 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e3a09-05f4-497b-ace5-0126c54d004f None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:56.562709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-393e3a09-05f4-497b-ace5-0126c54d004f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:56.563859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 628/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:56.570025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805f07b-ca09-4fa5-adfb-be7b655ca760 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:56.675837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805f07b-ca09-4fa5-adfb-be7b655ca760 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:56.710345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5dfa-83b9-4d26-96f8-a91c5dd8912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:56.710997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5dfa-83b9-4d26-96f8-a91c5dd8912b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:56.711279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5dfa-83b9-4d26-96f8-a91c5dd8912b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:56.711549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5dfa-83b9-4d26-96f8-a91c5dd8912b None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:56.712273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca5dfa-83b9-4d26-96f8-a91c5dd8912b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:56.712570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca5dfa-83b9-4d26-96f8-a91c5dd8912b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:56.713944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca5dfa-83b9-4d26-96f8-a91c5dd8912b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:56.724905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 642/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:56.731468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3a09-05f4-497b-ace5-0126c54d004f None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:56.841867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3a09-05f4-497b-ace5-0126c54d004f None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:56.875300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad74b8-6850-4093-a88f-a19c3b652a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:56.876100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad74b8-6850-4093-a88f-a19c3b652a81 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:56.876375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad74b8-6850-4093-a88f-a19c3b652a81 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:56.876644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad74b8-6850-4093-a88f-a19c3b652a81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:56.883581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad74b8-6850-4093-a88f-a19c3b652a81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:56.885015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad74b8-6850-4093-a88f-a19c3b652a81 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:56.898572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-a8ad74b8-6850-4093-a88f-a19c3b652a81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:42:56.899717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 629/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:56.905792 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5dfa-83b9-4d26-96f8-a91c5dd8912b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:57.003347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5dfa-83b9-4d26-96f8-a91c5dd8912b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:57.037058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05bc70-3519-4954-95a1-b66dc9813fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:57.037762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bc70-3519-4954-95a1-b66dc9813fc1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:57.038047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bc70-3519-4954-95a1-b66dc9813fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:57.038341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bc70-3519-4954-95a1-b66dc9813fc1 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:57.039129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05bc70-3519-4954-95a1-b66dc9813fc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:57.039416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05bc70-3519-4954-95a1-b66dc9813fc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:57.040858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05bc70-3519-4954-95a1-b66dc9813fc1 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:57.052614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 643/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:57.059335 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad74b8-6850-4093-a88f-a19c3b652a81 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:57.168978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad74b8-6850-4093-a88f-a19c3b652a81 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:57.203003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f1593-6ff7-4b11-b35f-baf86fe12490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:57.203886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1593-6ff7-4b11-b35f-baf86fe12490 None admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:57.204163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1593-6ff7-4b11-b35f-baf86fe12490 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:57.204436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1593-6ff7-4b11-b35f-baf86fe12490 None admin] PATH_INFO: `/v3/projects/e91226b635934bfcb949577491791af4/users/4e04cc7f60894946aace79d4c2875f53/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:57.206642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f1593-6ff7-4b11-b35f-baf86fe12490 None admin] RBAC: Authorizing `identity:create_grant(project_id=e91226b635934bfcb949577491791af4, user_id=4e04cc7f60894946aace79d4c2875f53, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:57.208066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f1593-6ff7-4b11-b35f-baf86fe12490 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:57.223161 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 630/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Oct 28 19:42:57 2022] PUT /identity/v3/projects/e91226b635934bfcb949577491791af4/users/4e04cc7f60894946aace79d4c2875f53/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:42:59.497581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a995f8-8325-40ca-8fb5-f7c05ab0de58 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:59.498544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a995f8-8325-40ca-8fb5-f7c05ab0de58 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:59.498544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a995f8-8325-40ca-8fb5-f7c05ab0de58 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:59.501340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 644/1274] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:42:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:59.507292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29477e40-9f7f-4cf7-85d8-7607ef59f4c0 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:59.508041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29477e40-9f7f-4cf7-85d8-7607ef59f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:59.508230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29477e40-9f7f-4cf7-85d8-7607ef59f4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:59.530909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-29477e40-9f7f-4cf7-85d8-7607ef59f4c0 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:59.532087 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-29477e40-9f7f-4cf7-85d8-7607ef59f4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:59.604679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 631/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:42:59.638675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a995f8-8325-40ca-8fb5-f7c05ab0de58 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:59.744363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a995f8-8325-40ca-8fb5-f7c05ab0de58 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:59.785726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3eb620-7452-4d77-9e44-f6fe340d8cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:59.786628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eb620-7452-4d77-9e44-f6fe340d8cb1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:59.786947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eb620-7452-4d77-9e44-f6fe340d8cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:59.787286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eb620-7452-4d77-9e44-f6fe340d8cb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:59.798628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3eb620-7452-4d77-9e44-f6fe340d8cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:42:59.805710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-ef3eb620-7452-4d77-9e44-f6fe340d8cb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:42:59.806965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 645/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Oct 28 19:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:59.813346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29477e40-9f7f-4cf7-85d8-7607ef59f4c0 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:59.914279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29477e40-9f7f-4cf7-85d8-7607ef59f4c0 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:59.948201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d118-45d3-4ce7-b563-870bc2b37d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:59.948866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d118-45d3-4ce7-b563-870bc2b37d60 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:59.949145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d118-45d3-4ce7-b563-870bc2b37d60 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:59.949417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d118-45d3-4ce7-b563-870bc2b37d60 None admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:59.950292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8d118-45d3-4ce7-b563-870bc2b37d60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:59.950506 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8d118-45d3-4ce7-b563-870bc2b37d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:59.951885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8d118-45d3-4ce7-b563-870bc2b37d60 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:59.959932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 632/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Oct 28 19:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:59.966173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3eb620-7452-4d77-9e44-f6fe340d8cb1 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:00.067927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3eb620-7452-4d77-9e44-f6fe340d8cb1 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:00.115961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64193bca-8026-4751-92d3-e16cd27ab74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:00.116751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64193bca-8026-4751-92d3-e16cd27ab74d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.117029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64193bca-8026-4751-92d3-e16cd27ab74d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.117299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64193bca-8026-4751-92d3-e16cd27ab74d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.128709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64193bca-8026-4751-92d3-e16cd27ab74d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:00.130210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64193bca-8026-4751-92d3-e16cd27ab74d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:00.147233 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-64193bca-8026-4751-92d3-e16cd27ab74d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:43:00.148389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 646/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:00.154358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d118-45d3-4ce7-b563-870bc2b37d60 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:00.276304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d118-45d3-4ce7-b563-870bc2b37d60 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:00.316293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f7177-9fc0-449f-b47a-6a73ba9b1781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:00.316939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f7177-9fc0-449f-b47a-6a73ba9b1781 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.317229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f7177-9fc0-449f-b47a-6a73ba9b1781 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.317500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f7177-9fc0-449f-b47a-6a73ba9b1781 None admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.318306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f7177-9fc0-449f-b47a-6a73ba9b1781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:00.318543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f7177-9fc0-449f-b47a-6a73ba9b1781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:00.320028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f7177-9fc0-449f-b47a-6a73ba9b1781 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:00.331552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 633/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:00.338107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64193bca-8026-4751-92d3-e16cd27ab74d None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:00.447230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64193bca-8026-4751-92d3-e16cd27ab74d None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:00.490595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38370ea-afe1-4468-bebc-6d4e2c37f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:00.491745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38370ea-afe1-4468-bebc-6d4e2c37f6e0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.492054 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38370ea-afe1-4468-bebc-6d4e2c37f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.492343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38370ea-afe1-4468-bebc-6d4e2c37f6e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.504771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38370ea-afe1-4468-bebc-6d4e2c37f6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:00.506610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38370ea-afe1-4468-bebc-6d4e2c37f6e0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:00.520606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-a38370ea-afe1-4468-bebc-6d4e2c37f6e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:43:00.521793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 647/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:00.527965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f7177-9fc0-449f-b47a-6a73ba9b1781 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:00.632726 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f7177-9fc0-449f-b47a-6a73ba9b1781 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:00.666503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9de5d-4400-4f98-b7ad-ae673f3d6111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:00.667171 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9de5d-4400-4f98-b7ad-ae673f3d6111 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.667449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9de5d-4400-4f98-b7ad-ae673f3d6111 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.667717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9de5d-4400-4f98-b7ad-ae673f3d6111 None admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.668534 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9de5d-4400-4f98-b7ad-ae673f3d6111 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:00.668833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9de5d-4400-4f98-b7ad-ae673f3d6111 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:00.670295 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9de5d-4400-4f98-b7ad-ae673f3d6111 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:00.686968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 634/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Oct 28 19:43:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:00.692995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38370ea-afe1-4468-bebc-6d4e2c37f6e0 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:00.807825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38370ea-afe1-4468-bebc-6d4e2c37f6e0 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:00.843386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed138f72-45d2-4152-ae6b-f36ca5cc3511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:00.844020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed138f72-45d2-4152-ae6b-f36ca5cc3511 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.844293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed138f72-45d2-4152-ae6b-f36ca5cc3511 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.844566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed138f72-45d2-4152-ae6b-f36ca5cc3511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.909398 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed138f72-45d2-4152-ae6b-f36ca5cc3511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:00.911170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed138f72-45d2-4152-ae6b-f36ca5cc3511 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.007300 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 648/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:43:01.016905 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9de5d-4400-4f98-b7ad-ae673f3d6111 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.127407 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9de5d-4400-4f98-b7ad-ae673f3d6111 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.165119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309d8cf-b78e-4549-b529-57f985a28336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.165832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309d8cf-b78e-4549-b529-57f985a28336 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.166123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309d8cf-b78e-4549-b529-57f985a28336 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.166381 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309d8cf-b78e-4549-b529-57f985a28336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.176343 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309d8cf-b78e-4549-b529-57f985a28336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:01.177770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309d8cf-b78e-4549-b529-57f985a28336 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.194293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-c309d8cf-b78e-4549-b529-57f985a28336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:43:01.195461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 635/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:01.204880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed138f72-45d2-4152-ae6b-f36ca5cc3511 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.311037 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed138f72-45d2-4152-ae6b-f36ca5cc3511 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.348975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113616d-e658-4a74-90e5-f2cfcc814834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.349621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113616d-e658-4a74-90e5-f2cfcc814834 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.349976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113616d-e658-4a74-90e5-f2cfcc814834 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.350245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113616d-e658-4a74-90e5-f2cfcc814834 None admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.350967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113616d-e658-4a74-90e5-f2cfcc814834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:01.351266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113616d-e658-4a74-90e5-f2cfcc814834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:01.352740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113616d-e658-4a74-90e5-f2cfcc814834 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.364733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 649/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:01.371346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309d8cf-b78e-4549-b529-57f985a28336 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.472132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309d8cf-b78e-4549-b529-57f985a28336 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.505893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1821eb3-338a-4b2b-9a56-d58a9d16a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.506727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1821eb3-338a-4b2b-9a56-d58a9d16a89e None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.507004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1821eb3-338a-4b2b-9a56-d58a9d16a89e None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.507281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1821eb3-338a-4b2b-9a56-d58a9d16a89e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.514029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1821eb3-338a-4b2b-9a56-d58a9d16a89e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:01.515491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1821eb3-338a-4b2b-9a56-d58a9d16a89e None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.528489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING keystone.server.flask.application [None req-d1821eb3-338a-4b2b-9a56-d58a9d16a89e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:43:01.529632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 636/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:01.536166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113616d-e658-4a74-90e5-f2cfcc814834 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.637369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113616d-e658-4a74-90e5-f2cfcc814834 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.672567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ed5d8-cc3f-4559-8781-0bc76be6b3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.673219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ed5d8-cc3f-4559-8781-0bc76be6b3f0 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.673497 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ed5d8-cc3f-4559-8781-0bc76be6b3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.673767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ed5d8-cc3f-4559-8781-0bc76be6b3f0 None admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.674573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ed5d8-cc3f-4559-8781-0bc76be6b3f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:01.674879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ed5d8-cc3f-4559-8781-0bc76be6b3f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:01.676303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ed5d8-cc3f-4559-8781-0bc76be6b3f0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.688393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 650/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:01.694752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1821eb3-338a-4b2b-9a56-d58a9d16a89e None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.816081 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1821eb3-338a-4b2b-9a56-d58a9d16a89e None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.853997 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025626ab-eb61-4e17-952d-4edc6e49b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.854671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025626ab-eb61-4e17-952d-4edc6e49b977 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.854944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025626ab-eb61-4e17-952d-4edc6e49b977 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.855214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025626ab-eb61-4e17-952d-4edc6e49b977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.856031 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025626ab-eb61-4e17-952d-4edc6e49b977 None admin] RBAC: Adding query filter params (role.id=a8264e9fa2bc48e3a9d88793eecdf6f9, scope.project.id=e91226b635934bfcb949577491791af4, user.id=4e04cc7f60894946aace79d4c2875f53) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:01.856339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025626ab-eb61-4e17-952d-4edc6e49b977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:01.857766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025626ab-eb61-4e17-952d-4edc6e49b977 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.863566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 637/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/role_assignments?user.id=4e04cc7f60894946aace79d4c2875f53&scope.project.id=e91226b635934bfcb949577491791af4&role.id=a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:04.181776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa9674-e9ed-4ba5-ab5a-994b54bb35cb None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:04.182374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa9674-e9ed-4ba5-ab5a-994b54bb35cb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:04.182374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa9674-e9ed-4ba5-ab5a-994b54bb35cb None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:04.184153 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 651/1288] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:04.190475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58661abf-d623-4f72-abd5-8e89d2905733 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:04.191186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58661abf-d623-4f72-abd5-8e89d2905733 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:04.191323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58661abf-d623-4f72-abd5-8e89d2905733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:04.211461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-58661abf-d623-4f72-abd5-8e89d2905733 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:04.212644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-58661abf-d623-4f72-abd5-8e89d2905733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:04.280464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 638/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:43:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:43:04.306069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa9674-e9ed-4ba5-ab5a-994b54bb35cb None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:04.435148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa9674-e9ed-4ba5-ab5a-994b54bb35cb None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:04.470286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f5e24-8b1f-4030-9d6f-8044c2dc865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:04.471097 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f5e24-8b1f-4030-9d6f-8044c2dc865e None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:04.471371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f5e24-8b1f-4030-9d6f-8044c2dc865e None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:04.471643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f5e24-8b1f-4030-9d6f-8044c2dc865e None admin] PATH_INFO: `/v3/services/placement` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:04.472304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f5e24-8b1f-4030-9d6f-8044c2dc865e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:04.473688 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f5e24-8b1f-4030-9d6f-8044c2dc865e None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:04.484968 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-2c0f5e24-8b1f-4030-9d6f-8044c2dc865e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:43:04.486144 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 652/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Oct 28 19:43:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:04.492662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58661abf-d623-4f72-abd5-8e89d2905733 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:04.592621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58661abf-d623-4f72-abd5-8e89d2905733 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:04.630619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b6de7-e4bc-466f-bc4c-480633fa2c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:04.631628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6de7-e4bc-466f-bc4c-480633fa2c8a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:04.632035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6de7-e4bc-466f-bc4c-480633fa2c8a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:04.632452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b6de7-e4bc-466f-bc4c-480633fa2c8a None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:04.633566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b6de7-e4bc-466f-bc4c-480633fa2c8a None admin] RBAC: Adding query filter params (name=placement) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:04.634043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b6de7-e4bc-466f-bc4c-480633fa2c8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:04.636249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b6de7-e4bc-466f-bc4c-480633fa2c8a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:04.643219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 639/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Oct 28 19:43:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:04.649119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f5e24-8b1f-4030-9d6f-8044c2dc865e None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:04.748810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f5e24-8b1f-4030-9d6f-8044c2dc865e None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:04.789946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3a8c1-9a81-49e4-a86b-2d6586692fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:04.790748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3a8c1-9a81-49e4-a86b-2d6586692fb1 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:04.791050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3a8c1-9a81-49e4-a86b-2d6586692fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:04.791332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3a8c1-9a81-49e4-a86b-2d6586692fb1 None admin] PATH_INFO: `/v3/services` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:04.792133 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3a8c1-9a81-49e4-a86b-2d6586692fb1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:04.792412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3a8c1-9a81-49e4-a86b-2d6586692fb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:04.794009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3a8c1-9a81-49e4-a86b-2d6586692fb1 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:04.799582 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 653/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Oct 28 19:43:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:07.088209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc8961-35c1-476f-a030-8aaa54fcb7b8 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.089149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc8961-35c1-476f-a030-8aaa54fcb7b8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.089149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc8961-35c1-476f-a030-8aaa54fcb7b8 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:07.091912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 640/1293] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:43:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:07.100190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bceeff-9c97-4844-9b71-cd31ee4dbbdb None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.100648 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bceeff-9c97-4844-9b71-cd31ee4dbbdb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.100746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bceeff-9c97-4844-9b71-cd31ee4dbbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:07.119452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b1bceeff-9c97-4844-9b71-cd31ee4dbbdb None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:07.120623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b1bceeff-9c97-4844-9b71-cd31ee4dbbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:07.197483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 654/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:43:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:43:07.231438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc8961-35c1-476f-a030-8aaa54fcb7b8 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:07.337988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc8961-35c1-476f-a030-8aaa54fcb7b8 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:07.372135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a76adf-7390-405f-80e3-f337b7c84fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:07.372731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a76adf-7390-405f-80e3-f337b7c84fb5 None admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.373013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a76adf-7390-405f-80e3-f337b7c84fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.373296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a76adf-7390-405f-80e3-f337b7c84fb5 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:07.374014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a76adf-7390-405f-80e3-f337b7c84fb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:07.375492 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a76adf-7390-405f-80e3-f337b7c84fb5 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:07.394319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 641/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Oct 28 19:43:07 2022] POST /identity/v3/services => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:43:09.717918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8bb41-5125-47bf-81dc-210368d7ff15 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.718759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8bb41-5125-47bf-81dc-210368d7ff15 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.718892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8bb41-5125-47bf-81dc-210368d7ff15 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.721697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 655/1296] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:43:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:09.730781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3f07-af98-4004-9a64-7d681653b22b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.731528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3f07-af98-4004-9a64-7d681653b22b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.731691 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3f07-af98-4004-9a64-7d681653b22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.752195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1f7a3f07-af98-4004-9a64-7d681653b22b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:09.753364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1f7a3f07-af98-4004-9a64-7d681653b22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:09.836459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 642/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:43:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:43:09.862499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8bb41-5125-47bf-81dc-210368d7ff15 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:09.969801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8bb41-5125-47bf-81dc-210368d7ff15 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:10.005672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e6a59-6bfc-4a16-8613-a595bc5fdca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:10.006511 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e6a59-6bfc-4a16-8613-a595bc5fdca9 None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:10.006782 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e6a59-6bfc-4a16-8613-a595bc5fdca9 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:10.007052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e6a59-6bfc-4a16-8613-a595bc5fdca9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:10.007699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e6a59-6bfc-4a16-8613-a595bc5fdca9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:10.009080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e6a59-6bfc-4a16-8613-a595bc5fdca9 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:10.020194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-f39e6a59-6bfc-4a16-8613-a595bc5fdca9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:43:10.021352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 656/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Oct 28 19:43:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:10.030755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a3f07-af98-4004-9a64-7d681653b22b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:10.125888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a3f07-af98-4004-9a64-7d681653b22b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:10.160162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d3140-77ff-4ad4-ba05-f69c13642298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:10.160823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3140-77ff-4ad4-ba05-f69c13642298 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:10.161104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3140-77ff-4ad4-ba05-f69c13642298 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:10.161383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3140-77ff-4ad4-ba05-f69c13642298 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:10.162115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d3140-77ff-4ad4-ba05-f69c13642298 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:10.162480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d3140-77ff-4ad4-ba05-f69c13642298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:10.163858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d3140-77ff-4ad4-ba05-f69c13642298 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:10.169052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 643/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Oct 28 19:43:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:10.175194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e6a59-6bfc-4a16-8613-a595bc5fdca9 None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:10.275947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e6a59-6bfc-4a16-8613-a595bc5fdca9 None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:10.310355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa3242-41c7-4dd8-ba2f-c3b1fec5569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:10.310985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa3242-41c7-4dd8-ba2f-c3b1fec5569d None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:10.311265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa3242-41c7-4dd8-ba2f-c3b1fec5569d None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:10.311540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa3242-41c7-4dd8-ba2f-c3b1fec5569d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:10.312312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa3242-41c7-4dd8-ba2f-c3b1fec5569d None admin] RBAC: Adding query filter params (interface=public, service_id=05e7fcccfa854de7898437e36b9f84c7, region_id=RegionOne) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:10.312615 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa3242-41c7-4dd8-ba2f-c3b1fec5569d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:10.314008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa3242-41c7-4dd8-ba2f-c3b1fec5569d None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:10.319462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 657/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Oct 28 19:43:10 2022] GET /identity/v3/endpoints?service_id=05e7fcccfa854de7898437e36b9f84c7&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:10.328576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d3140-77ff-4ad4-ba05-f69c13642298 None admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:10.436564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d3140-77ff-4ad4-ba05-f69c13642298 None admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:10.470697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea893b1a-1a32-4c0b-8a48-3a58278028d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:10.471445 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea893b1a-1a32-4c0b-8a48-3a58278028d7 None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:10.471727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea893b1a-1a32-4c0b-8a48-3a58278028d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:10.471996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea893b1a-1a32-4c0b-8a48-3a58278028d7 None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:10.472675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea893b1a-1a32-4c0b-8a48-3a58278028d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:10.474128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea893b1a-1a32-4c0b-8a48-3a58278028d7 None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:10.480909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 644/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Oct 28 19:43:10 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:43:12.787744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68256d0f-3277-4b3c-ab9a-7893525b55b4 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:12.788318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68256d0f-3277-4b3c-ab9a-7893525b55b4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:12.788318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68256d0f-3277-4b3c-ab9a-7893525b55b4 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:12.790070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 658/1302] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:12.795547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716833e-13c7-4a28-badd-7bac6096ed51 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:12.795984 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716833e-13c7-4a28-badd-7bac6096ed51 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:12.796085 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716833e-13c7-4a28-badd-7bac6096ed51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:12.814008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b716833e-13c7-4a28-badd-7bac6096ed51 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:12.815243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b716833e-13c7-4a28-badd-7bac6096ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:12.898568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 645/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:43:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:43:12.933638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68256d0f-3277-4b3c-ab9a-7893525b55b4 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:13.034199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68256d0f-3277-4b3c-ab9a-7893525b55b4 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:13.067276 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6381cc-9616-47da-a04e-d79f1630571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:13.068053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6381cc-9616-47da-a04e-d79f1630571b None admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:13.068328 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6381cc-9616-47da-a04e-d79f1630571b None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:13.068630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6381cc-9616-47da-a04e-d79f1630571b None admin] PATH_INFO: `/v3/services/placement` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:13.069295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6381cc-9616-47da-a04e-d79f1630571b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:13.070685 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6381cc-9616-47da-a04e-d79f1630571b None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:13.087448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING keystone.server.flask.application [None req-fc6381cc-9616-47da-a04e-d79f1630571b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:43:13.089277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 659/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Oct 28 19:43:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:13.095398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716833e-13c7-4a28-badd-7bac6096ed51 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:13.196111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716833e-13c7-4a28-badd-7bac6096ed51 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:13.230103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d05d55-d7d5-48c4-b513-85737daf2f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:13.230772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05d55-d7d5-48c4-b513-85737daf2f1a None admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:13.231058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05d55-d7d5-48c4-b513-85737daf2f1a None admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:13.231330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05d55-d7d5-48c4-b513-85737daf2f1a None admin] PATH_INFO: `/v3/services` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:13.232031 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d05d55-d7d5-48c4-b513-85737daf2f1a None admin] RBAC: Adding query filter params (name=placement) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:13.232336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d05d55-d7d5-48c4-b513-85737daf2f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:13.233698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d05d55-d7d5-48c4-b513-85737daf2f1a None admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:13.238891 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 646/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Oct 28 19:43:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:13.247129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6381cc-9616-47da-a04e-d79f1630571b None admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:13.356634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6381cc-9616-47da-a04e-d79f1630571b None admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:13.389294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40ed8d-8da1-41f4-8eac-60c037b9f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:13.390332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40ed8d-8da1-41f4-8eac-60c037b9f4a0 None admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:13.390709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40ed8d-8da1-41f4-8eac-60c037b9f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:13.391077 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40ed8d-8da1-41f4-8eac-60c037b9f4a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:13.392283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40ed8d-8da1-41f4-8eac-60c037b9f4a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:13.394538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40ed8d-8da1-41f4-8eac-60c037b9f4a0 None admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:13.417170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 660/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:43:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:44:17.921158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824f898-848a-4680-930d-49721262d2b3 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:17.922121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824f898-848a-4680-930d-49721262d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:17.922556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824f898-848a-4680-930d-49721262d2b3 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:17.928510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 647/1307] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:17.929849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70e17-6289-4e6d-bc0a-d9c8a774380c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:17.930297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70e17-6289-4e6d-bc0a-d9c8a774380c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:17.930426 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70e17-6289-4e6d-bc0a-d9c8a774380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:18.019018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-c1c70e17-6289-4e6d-bc0a-d9c8a774380c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:18.021233 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c1c70e17-6289-4e6d-bc0a-d9c8a774380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:18.184439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 661/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:44:18.206762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824f898-848a-4680-930d-49721262d2b3 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:18.208567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d824f898-848a-4680-930d-49721262d2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:18.351217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824f898-848a-4680-930d-49721262d2b3 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:18.453070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199b6b5-3ecd-4fd8-acff-e7e0eb632adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:18.454249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199b6b5-3ecd-4fd8-acff-e7e0eb632adf admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:18.454673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199b6b5-3ecd-4fd8-acff-e7e0eb632adf admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:18.455085 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199b6b5-3ecd-4fd8-acff-e7e0eb632adf admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:18.455979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199b6b5-3ecd-4fd8-acff-e7e0eb632adf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:18.457986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING py.warnings [None req-6199b6b5-3ecd-4fd8-acff-e7e0eb632adf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:44:18.457986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: warnings.warn(msg) Oct 28 19:44:18.457986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: Oct 28 19:44:18.459434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199b6b5-3ecd-4fd8-acff-e7e0eb632adf admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:18.479434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 648/1309] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:18 2022] GET /identity/v3/projects => generated 2553 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:44:20.833287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759d3bc-e1f5-4914-a2d2-2f2f2587853a None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:20.833852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759d3bc-e1f5-4914-a2d2-2f2f2587853a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:20.833852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759d3bc-e1f5-4914-a2d2-2f2f2587853a None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:20.835847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 662/1310] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:20.841117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812577f-eef1-49f7-a3a9-571bce47888b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:20.841552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812577f-eef1-49f7-a3a9-571bce47888b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:20.841647 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812577f-eef1-49f7-a3a9-571bce47888b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:20.920404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-3812577f-eef1-49f7-a3a9-571bce47888b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:20.921519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3812577f-eef1-49f7-a3a9-571bce47888b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:21.018338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 649/1311] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:21.069042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae6f8a-dd0c-4f56-8453-1c1801f29728 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.069566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae6f8a-dd0c-4f56-8453-1c1801f29728 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.069681 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae6f8a-dd0c-4f56-8453-1c1801f29728 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.071794 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 663/1312] 10.222.0.20 () {54 vars in 963 bytes} [Fri Oct 28 19:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:21.077875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48240a7-cf43-46ac-bfca-5fb2b68d97c6 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.078192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48240a7-cf43-46ac-bfca-5fb2b68d97c6 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.078465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48240a7-cf43-46ac-bfca-5fb2b68d97c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.167908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b48240a7-cf43-46ac-bfca-5fb2b68d97c6 None None] MFA Rules not processed for user `444a88451fbd4814b6d81023e68b54a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:21.169105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b48240a7-cf43-46ac-bfca-5fb2b68d97c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:21.246990 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 650/1313] 10.222.0.20 () {58 vars in 1060 bytes} [Fri Oct 28 19:44:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:21.256288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae6f8a-dd0c-4f56-8453-1c1801f29728 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:21.257905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d3ae6f8a-dd0c-4f56-8453-1c1801f29728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:21.362312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae6f8a-dd0c-4f56-8453-1c1801f29728 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:21.435514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176a157-f3a2-4d0c-bd99-0b14c3ac6ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:21.436157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176a157-f3a2-4d0c-bd99-0b14c3ac6ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.436436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176a157-f3a2-4d0c-bd99-0b14c3ac6ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.436707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176a157-f3a2-4d0c-bd99-0b14c3ac6ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.438635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9176a157-f3a2-4d0c-bd99-0b14c3ac6ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:21.550554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176a157-f3a2-4d0c-bd99-0b14c3ac6ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:21.552000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176a157-f3a2-4d0c-bd99-0b14c3ac6ed3 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:21.570524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 664/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:44:24.163760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07970d20-8748-4fe6-a5c0-fbfa90c1b2fc None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:24.164324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07970d20-8748-4fe6-a5c0-fbfa90c1b2fc None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:24.164324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07970d20-8748-4fe6-a5c0-fbfa90c1b2fc None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:24.166316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 651/1315] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:24.171786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56bcff-0d90-4d45-8079-83e62b6293bf None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:24.172179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56bcff-0d90-4d45-8079-83e62b6293bf None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:24.172323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56bcff-0d90-4d45-8079-83e62b6293bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:24.240974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-de56bcff-0d90-4d45-8079-83e62b6293bf None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:24.242201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-de56bcff-0d90-4d45-8079-83e62b6293bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:24.339344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 665/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:24.378095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07970d20-8748-4fe6-a5c0-fbfa90c1b2fc None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:24.379731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-07970d20-8748-4fe6-a5c0-fbfa90c1b2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:24.482851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07970d20-8748-4fe6-a5c0-fbfa90c1b2fc None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:24.564218 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0834be-8a68-4f46-b2f7-a2589eeb0968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:24.564884 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0834be-8a68-4f46-b2f7-a2589eeb0968 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:24.565163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0834be-8a68-4f46-b2f7-a2589eeb0968 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:24.565434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0834be-8a68-4f46-b2f7-a2589eeb0968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:24.567164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-df0834be-8a68-4f46-b2f7-a2589eeb0968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:24.686093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0834be-8a68-4f46-b2f7-a2589eeb0968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:24.687557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0834be-8a68-4f46-b2f7-a2589eeb0968 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:24.705992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 652/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:44:27.332175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd85be-3572-41ed-8786-6548a608fb0e None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:27.332741 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd85be-3572-41ed-8786-6548a608fb0e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:27.332741 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd85be-3572-41ed-8786-6548a608fb0e None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:27.334564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 666/1318] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:27.340839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8491587-0322-4cf1-8c24-41893f2caa33 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:27.341585 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8491587-0322-4cf1-8c24-41893f2caa33 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:27.341700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8491587-0322-4cf1-8c24-41893f2caa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:27.410395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c8491587-0322-4cf1-8c24-41893f2caa33 None None] MFA Rules not processed for user `693008c321194ab9b799c5831e6413ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:27.411634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c8491587-0322-4cf1-8c24-41893f2caa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:27.512544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 653/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:27.557971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd85be-3572-41ed-8786-6548a608fb0e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:27.559511 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-08dd85be-3572-41ed-8786-6548a608fb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:27.667624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd85be-3572-41ed-8786-6548a608fb0e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:27.741498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dbe9b-1e56-423e-81c0-feed469b5693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:27.742209 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dbe9b-1e56-423e-81c0-feed469b5693 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:27.742446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dbe9b-1e56-423e-81c0-feed469b5693 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:27.742715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dbe9b-1e56-423e-81c0-feed469b5693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:27.744408 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d56dbe9b-1e56-423e-81c0-feed469b5693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:27.856780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dbe9b-1e56-423e-81c0-feed469b5693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:27.858244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dbe9b-1e56-423e-81c0-feed469b5693 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:27.875827 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 667/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:44:30.759314 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128bc11-394b-4622-960a-cd417d00ddcc None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.759844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128bc11-394b-4622-960a-cd417d00ddcc None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.759983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128bc11-394b-4622-960a-cd417d00ddcc None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.762977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 654/1321] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:30.772858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8106f6-31d0-4904-a9f7-8094141fdf50 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.773278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8106f6-31d0-4904-a9f7-8094141fdf50 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.773548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8106f6-31d0-4904-a9f7-8094141fdf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.844912 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4f8106f6-31d0-4904-a9f7-8094141fdf50 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:30.846122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4f8106f6-31d0-4904-a9f7-8094141fdf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:30.941139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 668/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:30.982802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128bc11-394b-4622-960a-cd417d00ddcc None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:30.984404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a128bc11-394b-4622-960a-cd417d00ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:31.095746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128bc11-394b-4622-960a-cd417d00ddcc None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:31.172376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eea9a-9fb9-4a9c-8786-fdf60e1fa6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:31.173021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eea9a-9fb9-4a9c-8786-fdf60e1fa6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:31.173301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eea9a-9fb9-4a9c-8786-fdf60e1fa6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:31.173564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eea9a-9fb9-4a9c-8786-fdf60e1fa6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:31.175247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cf6eea9a-9fb9-4a9c-8786-fdf60e1fa6d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:31.282841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6eea9a-9fb9-4a9c-8786-fdf60e1fa6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:31.284312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6eea9a-9fb9-4a9c-8786-fdf60e1fa6d5 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:31.303112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 655/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:44:34.333934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54b09e-b1f4-4106-9bb9-c0b4554af12e None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.334539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54b09e-b1f4-4106-9bb9-c0b4554af12e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.334539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54b09e-b1f4-4106-9bb9-c0b4554af12e None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.336444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 669/1324] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:34.341940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac3d7e-ba84-4418-819b-cd69814f578c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.342424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac3d7e-ba84-4418-819b-cd69814f578c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.342505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac3d7e-ba84-4418-819b-cd69814f578c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.408543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e1ac3d7e-ba84-4418-819b-cd69814f578c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:34.409784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e1ac3d7e-ba84-4418-819b-cd69814f578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:34.510837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 656/1325] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:34.548382 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54b09e-b1f4-4106-9bb9-c0b4554af12e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:34.549918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1e54b09e-b1f4-4106-9bb9-c0b4554af12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:34.656986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54b09e-b1f4-4106-9bb9-c0b4554af12e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:34.730500 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe3c1b-22a9-44e0-902f-d727709904ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:34.731148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3c1b-22a9-44e0-902f-d727709904ed service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.731425 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3c1b-22a9-44e0-902f-d727709904ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.731698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe3c1b-22a9-44e0-902f-d727709904ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.733340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-dafe3c1b-22a9-44e0-902f-d727709904ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:34.844891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe3c1b-22a9-44e0-902f-d727709904ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:34.846373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe3c1b-22a9-44e0-902f-d727709904ed service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:34.864360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 670/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:44:37.249759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44dc3b-f99c-44cf-bf0e-b11243e6ca00 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:37.250410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44dc3b-f99c-44cf-bf0e-b11243e6ca00 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:37.250410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44dc3b-f99c-44cf-bf0e-b11243e6ca00 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:37.252112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 657/1327] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:37.257507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa1eb-cadb-45ed-9afc-01c9a446e27d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:37.257933 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa1eb-cadb-45ed-9afc-01c9a446e27d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:37.258203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa1eb-cadb-45ed-9afc-01c9a446e27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:37.324942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-99ffa1eb-cadb-45ed-9afc-01c9a446e27d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:37.326170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-99ffa1eb-cadb-45ed-9afc-01c9a446e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:37.421972 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 671/1328] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:37.458587 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44dc3b-f99c-44cf-bf0e-b11243e6ca00 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:37.460089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ba44dc3b-f99c-44cf-bf0e-b11243e6ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:37.563137 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44dc3b-f99c-44cf-bf0e-b11243e6ca00 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:37.639332 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fad976-2cd1-4b6c-8210-9517edd0f76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:37.640001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad976-2cd1-4b6c-8210-9517edd0f76f service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:37.640279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad976-2cd1-4b6c-8210-9517edd0f76f service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:37.640555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad976-2cd1-4b6c-8210-9517edd0f76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:37.642220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-65fad976-2cd1-4b6c-8210-9517edd0f76f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:37.752172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fad976-2cd1-4b6c-8210-9517edd0f76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:37.753836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fad976-2cd1-4b6c-8210-9517edd0f76f service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:37.773327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 658/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:44:40.144235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c4cb0-0837-4565-abfe-cbca9f892fc5 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.144833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c4cb0-0837-4565-abfe-cbca9f892fc5 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.144833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c4cb0-0837-4565-abfe-cbca9f892fc5 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.146582 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 672/1330] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:40.151940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c78ce5-9ba7-4676-bfe6-9555a484bad8 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.152346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c78ce5-9ba7-4676-bfe6-9555a484bad8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.152488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c78ce5-9ba7-4676-bfe6-9555a484bad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.218410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b9c78ce5-9ba7-4676-bfe6-9555a484bad8 None None] MFA Rules not processed for user `693008c321194ab9b799c5831e6413ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:40.219594 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b9c78ce5-9ba7-4676-bfe6-9555a484bad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:40.317196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 659/1331] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:40.354759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c4cb0-0837-4565-abfe-cbca9f892fc5 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:40.356310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4b3c4cb0-0837-4565-abfe-cbca9f892fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:40.460930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c4cb0-0837-4565-abfe-cbca9f892fc5 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:40.533811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb844917-8408-49a1-a35a-bba5c134ef80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:40.534489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb844917-8408-49a1-a35a-bba5c134ef80 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.534767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb844917-8408-49a1-a35a-bba5c134ef80 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.535040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb844917-8408-49a1-a35a-bba5c134ef80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.536970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-eb844917-8408-49a1-a35a-bba5c134ef80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:40.647817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb844917-8408-49a1-a35a-bba5c134ef80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:40.649283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb844917-8408-49a1-a35a-bba5c134ef80 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:40.669069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 673/1332] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:44:43.201023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c5bb4-5681-42fb-a7e4-b3d8094a83cd None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.201597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c5bb4-5681-42fb-a7e4-b3d8094a83cd None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.201597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c5bb4-5681-42fb-a7e4-b3d8094a83cd None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.203424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 660/1333] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:43.208781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45eae-ed4a-420d-9d62-c566fd9c08b5 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.209318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45eae-ed4a-420d-9d62-c566fd9c08b5 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.209318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45eae-ed4a-420d-9d62-c566fd9c08b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.276746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-acb45eae-ed4a-420d-9d62-c566fd9c08b5 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:43.277932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-acb45eae-ed4a-420d-9d62-c566fd9c08b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:43.376553 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 674/1334] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:43.428275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6e87e-d7f7-4fb9-b07d-bb3de57b4ac2 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.428570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6e87e-d7f7-4fb9-b07d-bb3de57b4ac2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.428841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6e87e-d7f7-4fb9-b07d-bb3de57b4ac2 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.430689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 661/1335] 10.222.0.20 () {54 vars in 963 bytes} [Fri Oct 28 19:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:43.437135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928b63-d9b2-4bd1-bfaf-b1371f1a5473 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.437426 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928b63-d9b2-4bd1-bfaf-b1371f1a5473 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.437705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928b63-d9b2-4bd1-bfaf-b1371f1a5473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.513359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-bf928b63-d9b2-4bd1-bfaf-b1371f1a5473 None None] MFA Rules not processed for user `444a88451fbd4814b6d81023e68b54a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:43.514587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-bf928b63-d9b2-4bd1-bfaf-b1371f1a5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:43.592305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 675/1336] 10.222.0.20 () {58 vars in 1060 bytes} [Fri Oct 28 19:44:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:43.601148 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6e87e-d7f7-4fb9-b07d-bb3de57b4ac2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:43.602726 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-43c6e87e-d7f7-4fb9-b07d-bb3de57b4ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:43.708973 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6e87e-d7f7-4fb9-b07d-bb3de57b4ac2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:43.783900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd6f62-0e22-4f49-a444-5381e1d6454d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:43.784558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd6f62-0e22-4f49-a444-5381e1d6454d service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.784841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd6f62-0e22-4f49-a444-5381e1d6454d service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.785127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd6f62-0e22-4f49-a444-5381e1d6454d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.787088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cbbd6f62-0e22-4f49-a444-5381e1d6454d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:43.902521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd6f62-0e22-4f49-a444-5381e1d6454d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:43.904065 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd6f62-0e22-4f49-a444-5381e1d6454d service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:43.922732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 662/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:44:46.510164 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eccd59-106a-4c11-91db-177823bc21a0 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.510963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eccd59-106a-4c11-91db-177823bc21a0 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.510963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eccd59-106a-4c11-91db-177823bc21a0 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.513866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 676/1338] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:46.518708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4c840-37de-419c-a124-54b0d8b82fb8 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.519464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4c840-37de-419c-a124-54b0d8b82fb8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.519610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4c840-37de-419c-a124-54b0d8b82fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.587451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-eeb4c840-37de-419c-a124-54b0d8b82fb8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:46.588722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-eeb4c840-37de-419c-a124-54b0d8b82fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:46.688066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 663/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:44:46.730019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eccd59-106a-4c11-91db-177823bc21a0 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:46.732243 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d8eccd59-106a-4c11-91db-177823bc21a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:46.840608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eccd59-106a-4c11-91db-177823bc21a0 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:46.917584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acbeee-98e9-45df-922d-6eb7fbcc9bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:46.918258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acbeee-98e9-45df-922d-6eb7fbcc9bdf service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.918536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acbeee-98e9-45df-922d-6eb7fbcc9bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.918806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acbeee-98e9-45df-922d-6eb7fbcc9bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.920459 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e1acbeee-98e9-45df-922d-6eb7fbcc9bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:47.037017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acbeee-98e9-45df-922d-6eb7fbcc9bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:47.038473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acbeee-98e9-45df-922d-6eb7fbcc9bdf service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:47.057806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 677/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:44:50.023582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2c64d-c52e-4570-9899-165070359483 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:50.024144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2c64d-c52e-4570-9899-165070359483 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:50.024144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2c64d-c52e-4570-9899-165070359483 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:50.025917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 664/1341] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:50.032525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f90ca6-8bb9-41fa-8b8a-ad905714f940 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:50.033209 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f90ca6-8bb9-41fa-8b8a-ad905714f940 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:50.033401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f90ca6-8bb9-41fa-8b8a-ad905714f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:50.113123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-42f90ca6-8bb9-41fa-8b8a-ad905714f940 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:50.114333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-42f90ca6-8bb9-41fa-8b8a-ad905714f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:50.227058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 678/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:50.264250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2c64d-c52e-4570-9899-165070359483 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:50.267948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2af2c64d-c52e-4570-9899-165070359483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:50.378187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2c64d-c52e-4570-9899-165070359483 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:50.382177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca485ec-d9e7-4221-bef8-1a3788c467c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:50.382815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca485ec-d9e7-4221-bef8-1a3788c467c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:50.383088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca485ec-d9e7-4221-bef8-1a3788c467c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:50.383351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca485ec-d9e7-4221-bef8-1a3788c467c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:50.392749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca485ec-d9e7-4221-bef8-1a3788c467c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:50.394219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca485ec-d9e7-4221-bef8-1a3788c467c5 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:50.403500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 665/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:44:54.818107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a159e6-8aa9-427f-ab1d-fabfeb2b65ef None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:54.818725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a159e6-8aa9-427f-ab1d-fabfeb2b65ef None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:54.818725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a159e6-8aa9-427f-ab1d-fabfeb2b65ef None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:54.820646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 679/1344] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:54.825722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d862c0-0aa0-4f1a-b4cd-995535192861 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:54.826181 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d862c0-0aa0-4f1a-b4cd-995535192861 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:54.826288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d862c0-0aa0-4f1a-b4cd-995535192861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:54.855524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-a3d862c0-0aa0-4f1a-b4cd-995535192861 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:54.856700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a3d862c0-0aa0-4f1a-b4cd-995535192861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:54.932820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 666/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:54.971405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a159e6-8aa9-427f-ab1d-fabfeb2b65ef None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:54.973473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-26a159e6-8aa9-427f-ab1d-fabfeb2b65ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:54.987847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a159e6-8aa9-427f-ab1d-fabfeb2b65ef None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:54.991534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252267c-fd0a-4ae6-b047-5c637defa41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:54.992165 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252267c-fd0a-4ae6-b047-5c637defa41d service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:54.992440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252267c-fd0a-4ae6-b047-5c637defa41d service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:54.992706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252267c-fd0a-4ae6-b047-5c637defa41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:55.002187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252267c-fd0a-4ae6-b047-5c637defa41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:55.003616 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252267c-fd0a-4ae6-b047-5c637defa41d service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:55.013220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 680/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:44:57.933169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927c6b8-9ead-4f68-88bf-5131f142825a None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:57.933679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927c6b8-9ead-4f68-88bf-5131f142825a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:57.933679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927c6b8-9ead-4f68-88bf-5131f142825a None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:57.935482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 667/1347] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:57.940893 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b611707-5c44-4a8e-b46f-ffb676dade2d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:57.941309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b611707-5c44-4a8e-b46f-ffb676dade2d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:57.941394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b611707-5c44-4a8e-b46f-ffb676dade2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:57.960202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-7b611707-5c44-4a8e-b46f-ffb676dade2d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:57.961366 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7b611707-5c44-4a8e-b46f-ffb676dade2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:57.970547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 681/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:44:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:44:58.008046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927c6b8-9ead-4f68-88bf-5131f142825a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:58.019661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927c6b8-9ead-4f68-88bf-5131f142825a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:58.023355 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9baef-0cf1-40d9-bc17-b5800b369a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:58.023991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9baef-0cf1-40d9-bc17-b5800b369a2f service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:58.024275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9baef-0cf1-40d9-bc17-b5800b369a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:58.024528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9baef-0cf1-40d9-bc17-b5800b369a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:58.033343 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9baef-0cf1-40d9-bc17-b5800b369a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:58.034802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9baef-0cf1-40d9-bc17-b5800b369a2f service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:58.044758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 668/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:44:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:45:02.497995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd046981-1a08-4458-9f88-7f1e2bb6b95d None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:02.498966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd046981-1a08-4458-9f88-7f1e2bb6b95d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:02.499243 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd046981-1a08-4458-9f88-7f1e2bb6b95d None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:02.501078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 682/1350] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:02.506486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42782805-c76c-4132-8798-b3dba837aeaf None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:02.506891 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42782805-c76c-4132-8798-b3dba837aeaf None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:02.507028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42782805-c76c-4132-8798-b3dba837aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:02.526165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-42782805-c76c-4132-8798-b3dba837aeaf None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:02.527383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-42782805-c76c-4132-8798-b3dba837aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:02.536498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 669/1351] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:02.575125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd046981-1a08-4458-9f88-7f1e2bb6b95d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:02.586274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd046981-1a08-4458-9f88-7f1e2bb6b95d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:02.589867 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef774d2-1b4a-4edf-a133-7e95e76feb4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:02.590537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef774d2-1b4a-4edf-a133-7e95e76feb4a service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:02.590810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef774d2-1b4a-4edf-a133-7e95e76feb4a service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:02.591080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef774d2-1b4a-4edf-a133-7e95e76feb4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:02.600259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef774d2-1b4a-4edf-a133-7e95e76feb4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:02.601738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef774d2-1b4a-4edf-a133-7e95e76feb4a service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:02.611587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 683/1352] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:45:07.907444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c5178-c3c4-4e4c-b3c6-d742c511f6b3 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:07.908283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c5178-c3c4-4e4c-b3c6-d742c511f6b3 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:07.908719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c5178-c3c4-4e4c-b3c6-d742c511f6b3 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:07.910675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 670/1353] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:45:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:07.916361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a40e36-ea99-4c99-84f8-581d18045a77 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:07.917114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a40e36-ea99-4c99-84f8-581d18045a77 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:07.917582 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a40e36-ea99-4c99-84f8-581d18045a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:08.031656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-a5a40e36-ea99-4c99-84f8-581d18045a77 None None] MFA Rules not processed for user `4e04cc7f60894946aace79d4c2875f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:08.033036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-a5a40e36-ea99-4c99-84f8-581d18045a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:08.165870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 684/1354] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:45:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:12.420008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9cc4-c898-49fa-8f3e-e2c85ff54fbe None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:12.420602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9cc4-c898-49fa-8f3e-e2c85ff54fbe None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:12.421035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9cc4-c898-49fa-8f3e-e2c85ff54fbe None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:12.423438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 671/1355] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:45:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:12.428956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471337-2848-4801-a68e-e8444e10adfe None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:12.429384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471337-2848-4801-a68e-e8444e10adfe None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:12.429700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471337-2848-4801-a68e-e8444e10adfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:12.450221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-bd471337-2848-4801-a68e-e8444e10adfe None None] MFA Rules not processed for user `4e04cc7f60894946aace79d4c2875f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:12.451453 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-bd471337-2848-4801-a68e-e8444e10adfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:12.461662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 685/1356] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:45:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:14.016828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbc0df-c3a2-4ce7-adc8-712c57691d8e None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:14.017431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbc0df-c3a2-4ce7-adc8-712c57691d8e None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:14.017431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbc0df-c3a2-4ce7-adc8-712c57691d8e None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:14.019384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 672/1357] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:14.024751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ede44-2f13-4506-b339-70b360913bb6 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:14.025256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ede44-2f13-4506-b339-70b360913bb6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:14.025341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ede44-2f13-4506-b339-70b360913bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:14.044139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-715ede44-2f13-4506-b339-70b360913bb6 None None] MFA Rules not processed for user `4e04cc7f60894946aace79d4c2875f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:14.045339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-715ede44-2f13-4506-b339-70b360913bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:14.055381 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 686/1358] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:45:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:45:17.897249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37091d-219a-4362-84e0-300671458086 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.897782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37091d-219a-4362-84e0-300671458086 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.897782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37091d-219a-4362-84e0-300671458086 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:17.899710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 673/1359] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:17.904927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd455-9d54-4ae7-a354-758f0cb2df26 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.905355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd455-9d54-4ae7-a354-758f0cb2df26 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.905773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd455-9d54-4ae7-a354-758f0cb2df26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:17.924713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-5bdfd455-9d54-4ae7-a354-758f0cb2df26 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:17.925878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5bdfd455-9d54-4ae7-a354-758f0cb2df26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:17.934428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 687/1360] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:17.983541 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dddbd-6657-4fd7-9269-cef5db773318 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.983944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dddbd-6657-4fd7-9269-cef5db773318 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.984315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dddbd-6657-4fd7-9269-cef5db773318 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:17.986495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 674/1361] 10.222.0.20 () {54 vars in 959 bytes} [Fri Oct 28 19:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:17.992148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a79e-1751-43e7-838e-39333bc7e236 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.992439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a79e-1751-43e7-838e-39333bc7e236 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.992718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a79e-1751-43e7-838e-39333bc7e236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:18.040255 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d5b9a79e-1751-43e7-838e-39333bc7e236 None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:18.041483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d5b9a79e-1751-43e7-838e-39333bc7e236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:18.125930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 688/1362] 10.222.0.20 () {58 vars in 1056 bytes} [Fri Oct 28 19:45:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:18.134683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dddbd-6657-4fd7-9269-cef5db773318 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:18.149969 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dddbd-6657-4fd7-9269-cef5db773318 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:18.155793 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82c41c-3ed1-4860-8aea-599f0400ce5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:18.156619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82c41c-3ed1-4860-8aea-599f0400ce5a service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:18.157001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82c41c-3ed1-4860-8aea-599f0400ce5a service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:18.157389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82c41c-3ed1-4860-8aea-599f0400ce5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:18.166932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82c41c-3ed1-4860-8aea-599f0400ce5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:18.168631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82c41c-3ed1-4860-8aea-599f0400ce5a service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:18.180287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 675/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:20.709141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cefb9-e8d1-4f56-822e-d08b5c750b65 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:20.710014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cefb9-e8d1-4f56-822e-d08b5c750b65 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:20.710321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cefb9-e8d1-4f56-822e-d08b5c750b65 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:20.712089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 689/1364] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:20.717360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93667573-698e-4e2c-8fd2-f54d98701a5f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:20.717788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93667573-698e-4e2c-8fd2-f54d98701a5f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:20.717905 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93667573-698e-4e2c-8fd2-f54d98701a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:20.740059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-93667573-698e-4e2c-8fd2-f54d98701a5f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:20.741493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-93667573-698e-4e2c-8fd2-f54d98701a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:20.749894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 676/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:20.795190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cefb9-e8d1-4f56-822e-d08b5c750b65 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:20.809109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cefb9-e8d1-4f56-822e-d08b5c750b65 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:20.814797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d9b0-034d-4e90-8202-729a996587d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:20.815429 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d9b0-034d-4e90-8202-729a996587d9 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:20.815704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d9b0-034d-4e90-8202-729a996587d9 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:20.815971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d9b0-034d-4e90-8202-729a996587d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:20.823845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d9b0-034d-4e90-8202-729a996587d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:20.825411 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d9b0-034d-4e90-8202-729a996587d9 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:20.834809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 690/1366] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:23.439560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa590f-cfb6-4d3d-9f7b-d145d78ca9f4 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:23.440115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa590f-cfb6-4d3d-9f7b-d145d78ca9f4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:23.440115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa590f-cfb6-4d3d-9f7b-d145d78ca9f4 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:23.441786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 677/1367] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:23.447368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a64c-8813-4157-a7e7-b1e7d356e674 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:23.447896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a64c-8813-4157-a7e7-b1e7d356e674 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:23.447896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a64c-8813-4157-a7e7-b1e7d356e674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:23.466951 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-8219a64c-8813-4157-a7e7-b1e7d356e674 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:23.468130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8219a64c-8813-4157-a7e7-b1e7d356e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:23.477562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 691/1368] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:23.522685 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d9694-5da5-49ce-b080-527c129a259e None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:23.522972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d9694-5da5-49ce-b080-527c129a259e None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:23.523448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d9694-5da5-49ce-b080-527c129a259e None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:23.525255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 678/1369] 10.222.0.20 () {54 vars in 959 bytes} [Fri Oct 28 19:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:23.530641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf5299-48f3-40e1-9e06-14e18e6bfbe1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:23.530930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf5299-48f3-40e1-9e06-14e18e6bfbe1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:23.531332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf5299-48f3-40e1-9e06-14e18e6bfbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:23.551883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2fbf5299-48f3-40e1-9e06-14e18e6bfbe1 None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:23.553076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2fbf5299-48f3-40e1-9e06-14e18e6bfbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:23.563276 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 692/1370] 10.222.0.20 () {58 vars in 1056 bytes} [Fri Oct 28 19:45:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:23.576950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d9694-5da5-49ce-b080-527c129a259e None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:23.592601 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d9694-5da5-49ce-b080-527c129a259e None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:23.598656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968667eb-5356-4046-96e7-ca412c7a4073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:23.599302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968667eb-5356-4046-96e7-ca412c7a4073 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:23.599580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968667eb-5356-4046-96e7-ca412c7a4073 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:23.599854 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968667eb-5356-4046-96e7-ca412c7a4073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:23.608163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968667eb-5356-4046-96e7-ca412c7a4073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:23.609751 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968667eb-5356-4046-96e7-ca412c7a4073 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:23.618953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 679/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:26.037906 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c543-c268-4aa5-8bb1-354d7d0c3cb8 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:26.039042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c543-c268-4aa5-8bb1-354d7d0c3cb8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:26.039554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18c543-c268-4aa5-8bb1-354d7d0c3cb8 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:26.042023 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 693/1372] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:26.047586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d402a53-7635-4c0b-86f2-12f53995563b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:26.048103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d402a53-7635-4c0b-86f2-12f53995563b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:26.048214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d402a53-7635-4c0b-86f2-12f53995563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:26.068525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0d402a53-7635-4c0b-86f2-12f53995563b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:26.070401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0d402a53-7635-4c0b-86f2-12f53995563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:26.080142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 680/1373] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:26.124977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18c543-c268-4aa5-8bb1-354d7d0c3cb8 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:26.141083 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18c543-c268-4aa5-8bb1-354d7d0c3cb8 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:26.146877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c84a83-3a68-4a07-805d-d02414d774a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:26.147541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c84a83-3a68-4a07-805d-d02414d774a0 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:26.147810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c84a83-3a68-4a07-805d-d02414d774a0 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:26.148101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c84a83-3a68-4a07-805d-d02414d774a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:26.156851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c84a83-3a68-4a07-805d-d02414d774a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:26.158472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c84a83-3a68-4a07-805d-d02414d774a0 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:26.162774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e2421-0c3a-4816-b27c-c6d4e36d09a6 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:26.163246 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e2421-0c3a-4816-b27c-c6d4e36d09a6 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:26.163526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e2421-0c3a-4816-b27c-c6d4e36d09a6 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:26.166603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 681/1374] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:45:26.168913 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 694/1375] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:26.170740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a570115-47a2-4e03-ae1f-2c3d33f3bd76 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:26.171131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a570115-47a2-4e03-ae1f-2c3d33f3bd76 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:26.171826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a570115-47a2-4e03-ae1f-2c3d33f3bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:26.192118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-9a570115-47a2-4e03-ae1f-2c3d33f3bd76 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:26.193303 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9a570115-47a2-4e03-ae1f-2c3d33f3bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:26.206517 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 682/1376] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:26.460267 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6a979-5980-4910-99ea-8198f210e05a None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:26.460519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6a979-5980-4910-99ea-8198f210e05a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:26.460969 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6a979-5980-4910-99ea-8198f210e05a None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:26.462955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 695/1377] 10.222.0.20 () {54 vars in 962 bytes} [Fri Oct 28 19:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:26.468466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711a36-8c4d-400a-9dbf-2ef6be87538b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:26.469026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711a36-8c4d-400a-9dbf-2ef6be87538b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:26.469445 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711a36-8c4d-400a-9dbf-2ef6be87538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:26.520977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-56711a36-8c4d-400a-9dbf-2ef6be87538b None None] MFA Rules not processed for user `ba2e2211f5d14ebcbd0221278248b868`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:26.522189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-56711a36-8c4d-400a-9dbf-2ef6be87538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:26.581038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 683/1378] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Oct 28 19:45:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:26.589337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6a979-5980-4910-99ea-8198f210e05a None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:26.600590 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6a979-5980-4910-99ea-8198f210e05a None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:26.604231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f1d40-48b7-432a-8fd6-c45761e247fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:26.605035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f1d40-48b7-432a-8fd6-c45761e247fa service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:26.605432 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f1d40-48b7-432a-8fd6-c45761e247fa service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:26.605768 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f1d40-48b7-432a-8fd6-c45761e247fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:26.615219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f1d40-48b7-432a-8fd6-c45761e247fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:26.616810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f1d40-48b7-432a-8fd6-c45761e247fa service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:26.640836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 696/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:45:28.516003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1189-fc82-425e-9961-d6d7cb1f0921 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:28.516603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1189-fc82-425e-9961-d6d7cb1f0921 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:28.516603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1189-fc82-425e-9961-d6d7cb1f0921 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:28.518362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 684/1380] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:28.524422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd037b-f185-46de-b615-5ec7b73bf2a7 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:28.525354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd037b-f185-46de-b615-5ec7b73bf2a7 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:28.525595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd037b-f185-46de-b615-5ec7b73bf2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:28.545466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0fdd037b-f185-46de-b615-5ec7b73bf2a7 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:28.546729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0fdd037b-f185-46de-b615-5ec7b73bf2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:28.555009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 697/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:28.599955 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1189-fc82-425e-9961-d6d7cb1f0921 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:28.615658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1189-fc82-425e-9961-d6d7cb1f0921 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:28.621579 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8726b-dc8a-49fe-a8f8-70068e0499a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:28.622328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8726b-dc8a-49fe-a8f8-70068e0499a1 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:28.622599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8726b-dc8a-49fe-a8f8-70068e0499a1 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:28.622871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8726b-dc8a-49fe-a8f8-70068e0499a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:28.631329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8726b-dc8a-49fe-a8f8-70068e0499a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:28.632916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8726b-dc8a-49fe-a8f8-70068e0499a1 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:28.643169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 685/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:31.002852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146e46-32a6-4773-b55d-80277a5e2935 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:31.003459 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146e46-32a6-4773-b55d-80277a5e2935 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:31.003459 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146e46-32a6-4773-b55d-80277a5e2935 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:31.005115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 698/1383] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:31.010357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d3993-7baf-4fad-abb8-8c29323a03dc None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:31.010790 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d3993-7baf-4fad-abb8-8c29323a03dc None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:31.010911 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d3993-7baf-4fad-abb8-8c29323a03dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:31.028887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d64d3993-7baf-4fad-abb8-8c29323a03dc None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:31.030052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d64d3993-7baf-4fad-abb8-8c29323a03dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:31.038562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 686/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:31.081444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146e46-32a6-4773-b55d-80277a5e2935 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:31.096910 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146e46-32a6-4773-b55d-80277a5e2935 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:31.103791 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9380917-f609-42ac-a629-ad9fecaeb089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:31.104430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9380917-f609-42ac-a629-ad9fecaeb089 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:31.104704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9380917-f609-42ac-a629-ad9fecaeb089 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:31.104977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9380917-f609-42ac-a629-ad9fecaeb089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:31.113624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9380917-f609-42ac-a629-ad9fecaeb089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:31.115235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9380917-f609-42ac-a629-ad9fecaeb089 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:31.125135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 699/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:33.488996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967df203-34af-4a88-8433-271fdc678b2d None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:33.489542 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967df203-34af-4a88-8433-271fdc678b2d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:33.489542 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967df203-34af-4a88-8433-271fdc678b2d None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:33.491477 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 687/1386] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:33.496807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bc344-add9-497f-b2fd-cef632f0b2a6 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:33.497219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bc344-add9-497f-b2fd-cef632f0b2a6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:33.497327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bc344-add9-497f-b2fd-cef632f0b2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:33.515691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-df1bc344-add9-497f-b2fd-cef632f0b2a6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:33.516886 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-df1bc344-add9-497f-b2fd-cef632f0b2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:33.524673 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 700/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:33.567143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967df203-34af-4a88-8433-271fdc678b2d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:33.581616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967df203-34af-4a88-8433-271fdc678b2d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:33.587117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e2716-be3c-457e-a9b0-73e718721295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:33.587844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e2716-be3c-457e-a9b0-73e718721295 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:33.588191 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e2716-be3c-457e-a9b0-73e718721295 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:33.588530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e2716-be3c-457e-a9b0-73e718721295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:33.596641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e2716-be3c-457e-a9b0-73e718721295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:33.598340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e2716-be3c-457e-a9b0-73e718721295 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:33.608140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 688/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:35.918883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39cab6-31fe-414f-acb7-540500519e0e None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:35.919409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39cab6-31fe-414f-acb7-540500519e0e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:35.919409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39cab6-31fe-414f-acb7-540500519e0e None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:35.921122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 701/1389] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:35.926955 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0120b-7320-4415-9b84-bcccea1a62ca None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:35.927375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0120b-7320-4415-9b84-bcccea1a62ca None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:35.927773 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0120b-7320-4415-9b84-bcccea1a62ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:35.951271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-afd0120b-7320-4415-9b84-bcccea1a62ca None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:35.952866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-afd0120b-7320-4415-9b84-bcccea1a62ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:35.961781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 689/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:36.005607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39cab6-31fe-414f-acb7-540500519e0e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:36.022212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39cab6-31fe-414f-acb7-540500519e0e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:36.028210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f41d2-7310-48b3-ba1d-039dae5b3092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:36.028846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f41d2-7310-48b3-ba1d-039dae5b3092 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:36.029135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f41d2-7310-48b3-ba1d-039dae5b3092 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:36.029391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f41d2-7310-48b3-ba1d-039dae5b3092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:36.038429 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f41d2-7310-48b3-ba1d-039dae5b3092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:36.040029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f41d2-7310-48b3-ba1d-039dae5b3092 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:36.049880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 702/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:38.350006 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b4ca3-b3d3-4881-b73b-b6b7d9c447be None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:38.350767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b4ca3-b3d3-4881-b73b-b6b7d9c447be None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:38.350767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b4ca3-b3d3-4881-b73b-b6b7d9c447be None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:38.352633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 690/1392] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:38.359439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9bfc7-8a96-4197-9ff9-2b90a15c230e None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:38.359977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9bfc7-8a96-4197-9ff9-2b90a15c230e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:38.359977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9bfc7-8a96-4197-9ff9-2b90a15c230e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:38.380537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-e7f9bfc7-8a96-4197-9ff9-2b90a15c230e None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:38.381738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e7f9bfc7-8a96-4197-9ff9-2b90a15c230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:38.390315 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 703/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:38.434808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b4ca3-b3d3-4881-b73b-b6b7d9c447be None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:38.453448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b4ca3-b3d3-4881-b73b-b6b7d9c447be None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:38.460767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85dab6-decb-482a-999c-251948cbe307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:38.461565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85dab6-decb-482a-999c-251948cbe307 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:38.462234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85dab6-decb-482a-999c-251948cbe307 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:38.462656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85dab6-decb-482a-999c-251948cbe307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:38.474530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85dab6-decb-482a-999c-251948cbe307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:38.476726 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85dab6-decb-482a-999c-251948cbe307 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:38.489260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 691/1394] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:40.825277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968795ba-a58b-4d58-88b1-d15d3cf551b8 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:40.825916 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968795ba-a58b-4d58-88b1-d15d3cf551b8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:40.825916 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968795ba-a58b-4d58-88b1-d15d3cf551b8 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:40.827653 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 704/1395] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:40.832993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375ae5-7cb2-4f40-951e-3567d18c5021 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:40.833454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375ae5-7cb2-4f40-951e-3567d18c5021 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:40.833555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375ae5-7cb2-4f40-951e-3567d18c5021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:40.851639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ee375ae5-7cb2-4f40-951e-3567d18c5021 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:40.852834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ee375ae5-7cb2-4f40-951e-3567d18c5021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:40.861464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 692/1396] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:40.905367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968795ba-a58b-4d58-88b1-d15d3cf551b8 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:40.920645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968795ba-a58b-4d58-88b1-d15d3cf551b8 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:40.926445 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78086cc-8728-4685-86f3-967aa7d07c16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:40.927123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78086cc-8728-4685-86f3-967aa7d07c16 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:40.927401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78086cc-8728-4685-86f3-967aa7d07c16 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:40.927671 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78086cc-8728-4685-86f3-967aa7d07c16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:40.936238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78086cc-8728-4685-86f3-967aa7d07c16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:40.937829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78086cc-8728-4685-86f3-967aa7d07c16 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:40.948135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 705/1397] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:42.535266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fca35-98c9-443f-8189-9dfebfa9d82d None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:42.535768 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fca35-98c9-443f-8189-9dfebfa9d82d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:42.535871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fca35-98c9-443f-8189-9dfebfa9d82d None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:42.537949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 693/1398] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:42.543465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e1865-f0cb-448e-a2fd-762040cee9f1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:42.543944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e1865-f0cb-448e-a2fd-762040cee9f1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:42.544071 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e1865-f0cb-448e-a2fd-762040cee9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:42.562597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-176e1865-f0cb-448e-a2fd-762040cee9f1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:42.563787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-176e1865-f0cb-448e-a2fd-762040cee9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:42.572252 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 706/1399] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:42.628308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd3734-0f15-4110-a5a2-a49f40939d4b None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:42.628706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd3734-0f15-4110-a5a2-a49f40939d4b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:42.628968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd3734-0f15-4110-a5a2-a49f40939d4b None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:42.630831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 694/1400] 10.222.0.20 () {54 vars in 961 bytes} [Fri Oct 28 19:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:42.636279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9e0f8-4ad7-4c07-8d85-6c76d47da9ea None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:42.636565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9e0f8-4ad7-4c07-8d85-6c76d47da9ea None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:42.636838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9e0f8-4ad7-4c07-8d85-6c76d47da9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:42.688446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-80a9e0f8-4ad7-4c07-8d85-6c76d47da9ea None None] MFA Rules not processed for user `f94515985e244af29f47a49c0dd415ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:42.689646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-80a9e0f8-4ad7-4c07-8d85-6c76d47da9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:42.751290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 707/1401] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Oct 28 19:45:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:45:42.758910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd3734-0f15-4110-a5a2-a49f40939d4b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:42.771365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd3734-0f15-4110-a5a2-a49f40939d4b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:42.774995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a98ed9-c555-40a4-825d-180ab37b2eba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f94515985e244af29f47a49c0dd415ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:42.775657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98ed9-c555-40a4-825d-180ab37b2eba service glance] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:42.775927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98ed9-c555-40a4-825d-180ab37b2eba service glance] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:42.776203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98ed9-c555-40a4-825d-180ab37b2eba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:42.785916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a98ed9-c555-40a4-825d-180ab37b2eba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:42.787688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a98ed9-c555-40a4-825d-180ab37b2eba service glance] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:42.798023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 695/1402] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:43.236856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6381-c9be-4f28-bde1-87d123418416 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:43.237171 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6381-c9be-4f28-bde1-87d123418416 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:43.237445 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6381-c9be-4f28-bde1-87d123418416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:43.286519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6f2e6381-c9be-4f28-bde1-87d123418416 None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:43.288005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6f2e6381-c9be-4f28-bde1-87d123418416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:43.298777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c545d-7eb7-4592-ae41-ec22970b597e None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:43.299063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c545d-7eb7-4592-ae41-ec22970b597e None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:43.299323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c545d-7eb7-4592-ae41-ec22970b597e None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:43.301078 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 696/1403] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:45:43.306138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e082af2-93e7-44e6-ae6e-748b07a5e57c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:43.306424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e082af2-93e7-44e6-ae6e-748b07a5e57c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:43.306705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e082af2-93e7-44e6-ae6e-748b07a5e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:43.324348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-6e082af2-93e7-44e6-ae6e-748b07a5e57c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:43.325583 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6e082af2-93e7-44e6-ae6e-748b07a5e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:43.333445 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 697/1404] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:45:43.352076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 708/1405] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:45:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:45:43.378435 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e082af2-93e7-44e6-ae6e-748b07a5e57c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:43.390593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e082af2-93e7-44e6-ae6e-748b07a5e57c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:43.396079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b0707-670a-4408-bdcf-cc1aee4c8c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:43.396731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b0707-670a-4408-bdcf-cc1aee4c8c0f service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:43.397012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b0707-670a-4408-bdcf-cc1aee4c8c0f service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:43.397119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edff821-0ec7-4ff2-b83a-6267bb579ba9 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:43.397286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b0707-670a-4408-bdcf-cc1aee4c8c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:43.397391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edff821-0ec7-4ff2-b83a-6267bb579ba9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:43.397555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edff821-0ec7-4ff2-b83a-6267bb579ba9 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:43.399391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 709/1406] 10.222.0.20 () {54 vars in 942 bytes} [Fri Oct 28 19:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:45:43.405485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e70457-4912-49e2-9ae8-2ff5b87e8d6c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:43.405763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e70457-4912-49e2-9ae8-2ff5b87e8d6c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:43.406029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e70457-4912-49e2-9ae8-2ff5b87e8d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:43.406159 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b0707-670a-4408-bdcf-cc1aee4c8c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:43.407757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b0707-670a-4408-bdcf-cc1aee4c8c0f service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:43.417532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 698/1407] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:45:43.456598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-95e70457-4912-49e2-9ae8-2ff5b87e8d6c None None] MFA Rules not processed for user `720ff448eaea42aaa7e399e5b950b01e`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:43.457899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-95e70457-4912-49e2-9ae8-2ff5b87e8d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:43.533932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 710/1408] 10.222.0.20 () {58 vars in 1039 bytes} [Fri Oct 28 19:45:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:45:43.544785 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b0707-670a-4408-bdcf-cc1aee4c8c0f service nova] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:43.556518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b0707-670a-4408-bdcf-cc1aee4c8c0f service nova] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:43.562231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf818fac-c45d-4e90-aff0-bc9613f1ab3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:43.562913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf818fac-c45d-4e90-aff0-bc9613f1ab3a service swift] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:43.563280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf818fac-c45d-4e90-aff0-bc9613f1ab3a service swift] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:43.563560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf818fac-c45d-4e90-aff0-bc9613f1ab3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:43.572931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf818fac-c45d-4e90-aff0-bc9613f1ab3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:43.574698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf818fac-c45d-4e90-aff0-bc9613f1ab3a service swift] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:43.584069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 699/1409] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:45:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:45:45.785924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821fb6-e774-483e-9620-92d7c3cc5997 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:45.786584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821fb6-e774-483e-9620-92d7c3cc5997 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:45.786584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821fb6-e774-483e-9620-92d7c3cc5997 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:45.792484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 711/1410] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:45:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:45.794021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e8f6d-0230-4355-b0f2-fe6e9a433fd4 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:45.794491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e8f6d-0230-4355-b0f2-fe6e9a433fd4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:45.794590 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e8f6d-0230-4355-b0f2-fe6e9a433fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:45.812418 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-454e8f6d-0230-4355-b0f2-fe6e9a433fd4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:45.813697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-454e8f6d-0230-4355-b0f2-fe6e9a433fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:45.821635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 700/1411] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:45:45.868105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb821fb6-e774-483e-9620-92d7c3cc5997 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:45.880903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb821fb6-e774-483e-9620-92d7c3cc5997 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:45.886313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe9ec9-70ca-4aea-b21b-426df64b22d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:45.886985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe9ec9-70ca-4aea-b21b-426df64b22d6 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:45.887268 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe9ec9-70ca-4aea-b21b-426df64b22d6 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:45.887547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe9ec9-70ca-4aea-b21b-426df64b22d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:45.895729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe9ec9-70ca-4aea-b21b-426df64b22d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:45.897329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe9ec9-70ca-4aea-b21b-426df64b22d6 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:45.907267 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 712/1412] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:06.866568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0b184-a8d0-415c-8164-ef3a02789256 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:06.867235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0b184-a8d0-415c-8164-ef3a02789256 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:06.867235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0b184-a8d0-415c-8164-ef3a02789256 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:06.868899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 701/1413] 10.222.0.20 () {54 vars in 918 bytes} [Fri Oct 28 19:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:06.874495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca77d6-7118-4512-a294-089adee2527e None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:06.875009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca77d6-7118-4512-a294-089adee2527e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:06.875121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca77d6-7118-4512-a294-089adee2527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:06.896177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-28ca77d6-7118-4512-a294-089adee2527e None None] MFA Rules not processed for user `4e04cc7f60894946aace79d4c2875f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:06.897310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-28ca77d6-7118-4512-a294-089adee2527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:06.909026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 713/1414] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Oct 28 19:46:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:06.929365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbbe1-0f89-4b59-8853-01400b71fba9 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:06.929873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbbe1-0f89-4b59-8853-01400b71fba9 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:06.930259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbbe1-0f89-4b59-8853-01400b71fba9 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:06.933125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 702/1415] 10.222.0.20 () {54 vars in 918 bytes} [Fri Oct 28 19:46:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:06.938658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522bba3-68df-4b1e-ab91-caf89f73c42d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:06.938946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522bba3-68df-4b1e-ab91-caf89f73c42d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:06.939221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522bba3-68df-4b1e-ab91-caf89f73c42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:06.959535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f522bba3-68df-4b1e-ab91-caf89f73c42d None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:06.960693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f522bba3-68df-4b1e-ab91-caf89f73c42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:06.971403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 714/1416] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Oct 28 19:46:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:09.744805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd5bab-151f-4ab8-9255-34c0754903e7 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:09.745770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd5bab-151f-4ab8-9255-34c0754903e7 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:09.745770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd5bab-151f-4ab8-9255-34c0754903e7 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:09.748099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:09.755960 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019d90f-c98a-499c-bede-a1ff868be672 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:09.756395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019d90f-c98a-499c-bede-a1ff868be672 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:09.756514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019d90f-c98a-499c-bede-a1ff868be672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:09.775009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0019d90f-c98a-499c-bede-a1ff868be672 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:09.776164 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0019d90f-c98a-499c-bede-a1ff868be672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:09.784249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:09.829460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd5bab-151f-4ab8-9255-34c0754903e7 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:09.846575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd5bab-151f-4ab8-9255-34c0754903e7 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:09.852848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541b344-a2f2-47cc-bf5d-70d452f6b239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:09.853482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541b344-a2f2-47cc-bf5d-70d452f6b239 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:09.853770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541b344-a2f2-47cc-bf5d-70d452f6b239 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:09.854049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541b344-a2f2-47cc-bf5d-70d452f6b239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:09.862229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541b344-a2f2-47cc-bf5d-70d452f6b239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:09.863820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541b344-a2f2-47cc-bf5d-70d452f6b239 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:09.873169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 704/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:11.264788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774eff3-6b31-4b01-84aa-1221b3accc11 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:11.265347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774eff3-6b31-4b01-84aa-1221b3accc11 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:11.265347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774eff3-6b31-4b01-84aa-1221b3accc11 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:11.267176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:11.273282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a680972-9861-420c-afb1-f2520414c53a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:11.274047 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a680972-9861-420c-afb1-f2520414c53a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:11.274358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a680972-9861-420c-afb1-f2520414c53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:11.301661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-5a680972-9861-420c-afb1-f2520414c53a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:11.303419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5a680972-9861-420c-afb1-f2520414c53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:11.317229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:11.500059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774eff3-6b31-4b01-84aa-1221b3accc11 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:11.521873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774eff3-6b31-4b01-84aa-1221b3accc11 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:11.529080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f6b14-5b83-4769-b719-3919d8217ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:11.529713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f6b14-5b83-4769-b719-3919d8217ce8 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:11.529987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f6b14-5b83-4769-b719-3919d8217ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:11.530294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f6b14-5b83-4769-b719-3919d8217ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:11.538988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f6b14-5b83-4769-b719-3919d8217ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:11.540652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f6b14-5b83-4769-b719-3919d8217ce8 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:11.550559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 717/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:12.911539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3784-ee4d-464f-af4b-58d2d143a4f2 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:12.912432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3784-ee4d-464f-af4b-58d2d143a4f2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:12.912432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3784-ee4d-464f-af4b-58d2d143a4f2 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:12.915490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:46:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:12.923259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a215e-a432-427e-aa59-63bdea58e748 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:12.923700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a215e-a432-427e-aa59-63bdea58e748 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:12.923818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a215e-a432-427e-aa59-63bdea58e748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:12.943397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-188a215e-a432-427e-aa59-63bdea58e748 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:12.944587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-188a215e-a432-427e-aa59-63bdea58e748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:12.953145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:46:13.109744 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc3784-ee4d-464f-af4b-58d2d143a4f2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:13.128507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc3784-ee4d-464f-af4b-58d2d143a4f2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:13.135734 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cc88-f8fc-4aa4-be81-c509bc7925fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:13.136377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cc88-f8fc-4aa4-be81-c509bc7925fd service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:13.136661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cc88-f8fc-4aa4-be81-c509bc7925fd service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:13.136930 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cc88-f8fc-4aa4-be81-c509bc7925fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:13.145363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23cc88-f8fc-4aa4-be81-c509bc7925fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:13.146987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23cc88-f8fc-4aa4-be81-c509bc7925fd service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:13.156382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 707/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:14.484586 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a3a6b-0d14-4759-805b-373b91d4edf8 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:14.485468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a3a6b-0d14-4759-805b-373b91d4edf8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:14.485468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a3a6b-0d14-4759-805b-373b91d4edf8 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:14.488377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:46:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:14.493819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8aaa6-d72e-40be-80c5-1ce003634245 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:14.494315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8aaa6-d72e-40be-80c5-1ce003634245 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:14.494421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8aaa6-d72e-40be-80c5-1ce003634245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:14.515456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-7bf8aaa6-d72e-40be-80c5-1ce003634245 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:14.516625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7bf8aaa6-d72e-40be-80c5-1ce003634245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:14.524963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:14.675589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a3a6b-0d14-4759-805b-373b91d4edf8 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:14.693576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a3a6b-0d14-4759-805b-373b91d4edf8 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:14.700748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153b9a6-b8a1-463e-ac4b-b81fdc1707c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:14.701409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153b9a6-b8a1-463e-ac4b-b81fdc1707c0 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:14.701664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153b9a6-b8a1-463e-ac4b-b81fdc1707c0 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:14.701933 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153b9a6-b8a1-463e-ac4b-b81fdc1707c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:14.710715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153b9a6-b8a1-463e-ac4b-b81fdc1707c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:14.712328 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153b9a6-b8a1-463e-ac4b-b81fdc1707c0 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:14.721981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 720/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:16.079195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eebe4b-643e-4bc0-b816-6f075ac7b399 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:16.079750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eebe4b-643e-4bc0-b816-6f075ac7b399 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:16.079750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eebe4b-643e-4bc0-b816-6f075ac7b399 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:16.081500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:16.086911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dac2b-a88e-4b35-8196-26ffadd4ae6b None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:16.087354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dac2b-a88e-4b35-8196-26ffadd4ae6b None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:16.087524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dac2b-a88e-4b35-8196-26ffadd4ae6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:16.106409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-075dac2b-a88e-4b35-8196-26ffadd4ae6b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:16.107676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-075dac2b-a88e-4b35-8196-26ffadd4ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:16.115787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:16.272316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eebe4b-643e-4bc0-b816-6f075ac7b399 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:16.297131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eebe4b-643e-4bc0-b816-6f075ac7b399 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:16.303606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b0513-7c21-4e25-a653-28144f0cafcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:16.304243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b0513-7c21-4e25-a653-28144f0cafcd service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:16.304522 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b0513-7c21-4e25-a653-28144f0cafcd service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:16.304791 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b0513-7c21-4e25-a653-28144f0cafcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:16.313097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b0513-7c21-4e25-a653-28144f0cafcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:16.314735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b0513-7c21-4e25-a653-28144f0cafcd service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:16.324120 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 710/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:17.607688 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4aa5c-4f95-4897-9f9b-426bc9a4a3fe None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:17.608203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4aa5c-4f95-4897-9f9b-426bc9a4a3fe None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:17.608203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4aa5c-4f95-4897-9f9b-426bc9a4a3fe None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:17.609985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:17.617592 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc63d9-56c7-4424-ad07-ecae2eb6a02f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:17.618067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc63d9-56c7-4424-ad07-ecae2eb6a02f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:17.618204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc63d9-56c7-4424-ad07-ecae2eb6a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:17.637551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-5bdc63d9-56c7-4424-ad07-ecae2eb6a02f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:17.638811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5bdc63d9-56c7-4424-ad07-ecae2eb6a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:17.647587 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:46:17.798336 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4aa5c-4f95-4897-9f9b-426bc9a4a3fe None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:17.815753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4aa5c-4f95-4897-9f9b-426bc9a4a3fe None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:17.821997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ecd67-410e-4892-a845-de69de3b4f99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:17.822674 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ecd67-410e-4892-a845-de69de3b4f99 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:17.822954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ecd67-410e-4892-a845-de69de3b4f99 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:17.823227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ecd67-410e-4892-a845-de69de3b4f99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:17.831964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ecd67-410e-4892-a845-de69de3b4f99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:17.833580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ecd67-410e-4892-a845-de69de3b4f99 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:17.843850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 723/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:19.125169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9017f-2036-4cb5-8ef8-cf25ff3aedf7 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:19.125728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9017f-2036-4cb5-8ef8-cf25ff3aedf7 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:19.125728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9017f-2036-4cb5-8ef8-cf25ff3aedf7 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:19.128874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:46:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:19.137527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffd45d-40ae-4ceb-b568-adfdbcc55078 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:19.138321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffd45d-40ae-4ceb-b568-adfdbcc55078 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:19.138431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffd45d-40ae-4ceb-b568-adfdbcc55078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:19.157729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-daffd45d-40ae-4ceb-b568-adfdbcc55078 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:19.158950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-daffd45d-40ae-4ceb-b568-adfdbcc55078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:19.167868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:19.325666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9017f-2036-4cb5-8ef8-cf25ff3aedf7 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:19.347604 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9017f-2036-4cb5-8ef8-cf25ff3aedf7 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:19.354320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6a293-b43b-474c-9cec-57d0589b9714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:19.354981 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6a293-b43b-474c-9cec-57d0589b9714 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:19.355299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6a293-b43b-474c-9cec-57d0589b9714 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:19.355578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6a293-b43b-474c-9cec-57d0589b9714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:19.364346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6a293-b43b-474c-9cec-57d0589b9714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:19.365942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6a293-b43b-474c-9cec-57d0589b9714 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:19.375340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 713/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:20.665133 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5007b1-ca75-4ae5-ba4b-11a8461003f0 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:20.665596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5007b1-ca75-4ae5-ba4b-11a8461003f0 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:20.665690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5007b1-ca75-4ae5-ba4b-11a8461003f0 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:20.668599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:46:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:20.674050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb143ece-12ed-40eb-b1a2-45e2cfc917b4 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:20.674524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb143ece-12ed-40eb-b1a2-45e2cfc917b4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:20.674619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb143ece-12ed-40eb-b1a2-45e2cfc917b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:20.694689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-fb143ece-12ed-40eb-b1a2-45e2cfc917b4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:20.695888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-fb143ece-12ed-40eb-b1a2-45e2cfc917b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:20.705116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:20.856637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5007b1-ca75-4ae5-ba4b-11a8461003f0 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:20.878613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5007b1-ca75-4ae5-ba4b-11a8461003f0 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:20.885077 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cacae8-14b9-481f-b78c-f1685b9e27a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:20.885715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cacae8-14b9-481f-b78c-f1685b9e27a1 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:20.885990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cacae8-14b9-481f-b78c-f1685b9e27a1 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:20.886295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cacae8-14b9-481f-b78c-f1685b9e27a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:20.894957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cacae8-14b9-481f-b78c-f1685b9e27a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:20.896503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cacae8-14b9-481f-b78c-f1685b9e27a1 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:20.905886 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 726/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:22.185815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18a63-6692-4b2b-ae8a-1bf29ce4c7fe None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:22.186462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18a63-6692-4b2b-ae8a-1bf29ce4c7fe None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:22.186462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18a63-6692-4b2b-ae8a-1bf29ce4c7fe None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:22.188183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:22.194577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2dc84-5fb8-455e-8c22-09f65e8bba76 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:22.195302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2dc84-5fb8-455e-8c22-09f65e8bba76 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:22.195453 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2dc84-5fb8-455e-8c22-09f65e8bba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:22.216602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f8f2dc84-5fb8-455e-8c22-09f65e8bba76 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:22.217859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f8f2dc84-5fb8-455e-8c22-09f65e8bba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:22.226446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:22.376787 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a18a63-6692-4b2b-ae8a-1bf29ce4c7fe None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:22.401725 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a18a63-6692-4b2b-ae8a-1bf29ce4c7fe None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:22.409320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5f02a-544c-463d-a753-e5da04087b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:22.409951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f02a-544c-463d-a753-e5da04087b03 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:22.410257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f02a-544c-463d-a753-e5da04087b03 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:22.410527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f02a-544c-463d-a753-e5da04087b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:22.419118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5f02a-544c-463d-a753-e5da04087b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:22.420695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5f02a-544c-463d-a753-e5da04087b03 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:22.430643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 716/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:24.649721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bdaf1-859b-440a-a175-b61b98286376 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:24.650188 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bdaf1-859b-440a-a175-b61b98286376 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:24.650277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bdaf1-859b-440a-a175-b61b98286376 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:24.652068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:24.657948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855bea-c0a4-40a0-9483-7df7b9122ffb None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:24.658463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855bea-c0a4-40a0-9483-7df7b9122ffb None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:24.658581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855bea-c0a4-40a0-9483-7df7b9122ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:24.678496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-23855bea-c0a4-40a0-9483-7df7b9122ffb None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:24.680299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-23855bea-c0a4-40a0-9483-7df7b9122ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:24.689118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:24.727695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bdaf1-859b-440a-a175-b61b98286376 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:24.741258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bdaf1-859b-440a-a175-b61b98286376 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:24.746043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67427650-84d5-4458-aa53-172247e17ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:24.746806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67427650-84d5-4458-aa53-172247e17ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:24.747082 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67427650-84d5-4458-aa53-172247e17ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:24.747351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67427650-84d5-4458-aa53-172247e17ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:24.756694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67427650-84d5-4458-aa53-172247e17ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:24.758132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67427650-84d5-4458-aa53-172247e17ff8 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:24.768180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 729/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:27.199358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db13a0-15d1-43c4-b368-acf68b40905c None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:27.200008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db13a0-15d1-43c4-b368-acf68b40905c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:27.200008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db13a0-15d1-43c4-b368-acf68b40905c None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:27.201775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:27.207947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f5e1-194c-4051-be36-e4a3e86bb32d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:27.208375 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f5e1-194c-4051-be36-e4a3e86bb32d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:27.208476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f5e1-194c-4051-be36-e4a3e86bb32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:27.235512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f414f5e1-194c-4051-be36-e4a3e86bb32d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:27.236695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f414f5e1-194c-4051-be36-e4a3e86bb32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:27.245531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:27.283703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db13a0-15d1-43c4-b368-acf68b40905c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:27.295488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db13a0-15d1-43c4-b368-acf68b40905c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:27.299681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459167b4-babf-472b-8197-c2d76286acd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:27.300351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459167b4-babf-472b-8197-c2d76286acd3 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:27.300632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459167b4-babf-472b-8197-c2d76286acd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:27.300903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459167b4-babf-472b-8197-c2d76286acd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:27.310762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459167b4-babf-472b-8197-c2d76286acd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:27.312200 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459167b4-babf-472b-8197-c2d76286acd3 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:27.321635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 719/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:29.927229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f5917-6643-4b63-8cbf-20bba50fa4e6 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:29.928072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f5917-6643-4b63-8cbf-20bba50fa4e6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:29.928072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f5917-6643-4b63-8cbf-20bba50fa4e6 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:29.930909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:29.937550 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d2e76-d0f1-42d6-9020-6bbea269741b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:29.938009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d2e76-d0f1-42d6-9020-6bbea269741b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:29.938149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d2e76-d0f1-42d6-9020-6bbea269741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:29.966068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d60d2e76-d0f1-42d6-9020-6bbea269741b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:29.967500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d60d2e76-d0f1-42d6-9020-6bbea269741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:29.976070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:30.014916 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f5917-6643-4b63-8cbf-20bba50fa4e6 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:30.028269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f5917-6643-4b63-8cbf-20bba50fa4e6 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:30.032909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2f2d4-2e40-4e24-8716-0b43b8d50039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:30.033578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2f2d4-2e40-4e24-8716-0b43b8d50039 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:30.033857 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2f2d4-2e40-4e24-8716-0b43b8d50039 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:30.034104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2f2d4-2e40-4e24-8716-0b43b8d50039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:30.043930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2f2d4-2e40-4e24-8716-0b43b8d50039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:30.045401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2f2d4-2e40-4e24-8716-0b43b8d50039 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:30.054853 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 732/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:32.492505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28267-bf70-465d-bceb-97bc8c366993 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:32.493106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28267-bf70-465d-bceb-97bc8c366993 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:32.493106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28267-bf70-465d-bceb-97bc8c366993 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:32.494890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:32.503620 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb3df1-30d9-4c1b-bee7-6356a2072502 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:32.504081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb3df1-30d9-4c1b-bee7-6356a2072502 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:32.504179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb3df1-30d9-4c1b-bee7-6356a2072502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:32.526172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fdcb3df1-30d9-4c1b-bee7-6356a2072502 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:32.527310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fdcb3df1-30d9-4c1b-bee7-6356a2072502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:32.536020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:32.574446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e28267-bf70-465d-bceb-97bc8c366993 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:32.586222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e28267-bf70-465d-bceb-97bc8c366993 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:32.591089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af472a2c-f33f-4336-85ed-c3fd36dc7b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:32.591947 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af472a2c-f33f-4336-85ed-c3fd36dc7b6b service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:32.592257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af472a2c-f33f-4336-85ed-c3fd36dc7b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:32.592626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af472a2c-f33f-4336-85ed-c3fd36dc7b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:32.605380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af472a2c-f33f-4336-85ed-c3fd36dc7b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:32.606829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af472a2c-f33f-4336-85ed-c3fd36dc7b6b service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:32.616067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 722/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:34.982971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e7579-3cd3-4398-aab7-ec7207f1987b None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:34.983557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e7579-3cd3-4398-aab7-ec7207f1987b None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:34.983557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e7579-3cd3-4398-aab7-ec7207f1987b None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:34.985195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:34.991662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44368f51-f09f-47ad-aae8-6c3c9f0bee10 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:34.992349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44368f51-f09f-47ad-aae8-6c3c9f0bee10 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:34.992555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44368f51-f09f-47ad-aae8-6c3c9f0bee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:35.013711 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-44368f51-f09f-47ad-aae8-6c3c9f0bee10 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:35.014912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-44368f51-f09f-47ad-aae8-6c3c9f0bee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:35.023158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:35.063800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e7579-3cd3-4398-aab7-ec7207f1987b None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:35.075659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e7579-3cd3-4398-aab7-ec7207f1987b None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:35.079306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680bfc7-4629-430d-8f1a-fad7f363f877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:35.079936 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680bfc7-4629-430d-8f1a-fad7f363f877 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:35.080211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680bfc7-4629-430d-8f1a-fad7f363f877 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:35.080506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680bfc7-4629-430d-8f1a-fad7f363f877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:35.090238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680bfc7-4629-430d-8f1a-fad7f363f877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:35.091774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680bfc7-4629-430d-8f1a-fad7f363f877 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:35.100939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 735/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:37.456873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a97f13-422b-4104-a867-d3946e873253 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:37.457442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a97f13-422b-4104-a867-d3946e873253 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:37.457442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a97f13-422b-4104-a867-d3946e873253 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:37.459242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:37.464761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77725474-2b4c-474b-b4cd-3c1be5aff33f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:37.465202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77725474-2b4c-474b-b4cd-3c1be5aff33f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:37.465309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77725474-2b4c-474b-b4cd-3c1be5aff33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:37.490005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-77725474-2b4c-474b-b4cd-3c1be5aff33f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:37.491567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-77725474-2b4c-474b-b4cd-3c1be5aff33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:37.502416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:37.545656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a97f13-422b-4104-a867-d3946e873253 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:37.559217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a97f13-422b-4104-a867-d3946e873253 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:37.563239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f19d7a-321f-4ae7-ab1f-a4d6ae9f4d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:37.563862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f19d7a-321f-4ae7-ab1f-a4d6ae9f4d1d service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:37.564134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f19d7a-321f-4ae7-ab1f-a4d6ae9f4d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:37.564430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f19d7a-321f-4ae7-ab1f-a4d6ae9f4d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:37.573666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f19d7a-321f-4ae7-ab1f-a4d6ae9f4d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:37.575257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f19d7a-321f-4ae7-ab1f-a4d6ae9f4d1d service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:37.585481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 725/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:39.951039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1c8f-ffa9-4ec8-aaa8-982838ddc4ea None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:39.951675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1c8f-ffa9-4ec8-aaa8-982838ddc4ea None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:39.951675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1c8f-ffa9-4ec8-aaa8-982838ddc4ea None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:39.953341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:39.959809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d82b5-8e97-4de7-9c12-f1aad9171209 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:39.960519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d82b5-8e97-4de7-9c12-f1aad9171209 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:39.960712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d82b5-8e97-4de7-9c12-f1aad9171209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:39.983554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1c0d82b5-8e97-4de7-9c12-f1aad9171209 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:39.984716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1c0d82b5-8e97-4de7-9c12-f1aad9171209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:39.993150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:40.031166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1c8f-ffa9-4ec8-aaa8-982838ddc4ea None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:40.047313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1c8f-ffa9-4ec8-aaa8-982838ddc4ea None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:40.051781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161234b4-21a7-459a-8de4-4db9203cb9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:40.052411 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161234b4-21a7-459a-8de4-4db9203cb9fc service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:40.052690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161234b4-21a7-459a-8de4-4db9203cb9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:40.052961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161234b4-21a7-459a-8de4-4db9203cb9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:40.062694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161234b4-21a7-459a-8de4-4db9203cb9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:40.064142 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161234b4-21a7-459a-8de4-4db9203cb9fc service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:40.073753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 738/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:42.438987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a516c-33df-4447-9e5a-94da9c5eebd2 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:42.439821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a516c-33df-4447-9e5a-94da9c5eebd2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:42.439980 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a516c-33df-4447-9e5a-94da9c5eebd2 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:42.442882 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:42.448302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496259-f4eb-457a-9be3-9bdb45703387 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:42.448767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496259-f4eb-457a-9be3-9bdb45703387 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:42.448878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496259-f4eb-457a-9be3-9bdb45703387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:42.468212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-00496259-f4eb-457a-9be3-9bdb45703387 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:42.469385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-00496259-f4eb-457a-9be3-9bdb45703387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:42.478198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:42.516020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a516c-33df-4447-9e5a-94da9c5eebd2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:42.529494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a516c-33df-4447-9e5a-94da9c5eebd2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:42.534308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbade2b-f4ae-49db-9b47-240d54acf3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:42.534936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbade2b-f4ae-49db-9b47-240d54acf3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:42.535216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbade2b-f4ae-49db-9b47-240d54acf3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:42.535487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbade2b-f4ae-49db-9b47-240d54acf3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:42.546231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbade2b-f4ae-49db-9b47-240d54acf3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:42.547674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbade2b-f4ae-49db-9b47-240d54acf3d5 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:42.557024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 728/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:44.866701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150048c-79ec-48b7-bb54-e9f7349fa692 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:44.867597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150048c-79ec-48b7-bb54-e9f7349fa692 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:44.867597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150048c-79ec-48b7-bb54-e9f7349fa692 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:44.870446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:44.876667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1c8d-b06b-4c65-a284-07acac8f6892 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:44.877175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1c8d-b06b-4c65-a284-07acac8f6892 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:44.877175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1c8d-b06b-4c65-a284-07acac8f6892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:44.897462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-48ee1c8d-b06b-4c65-a284-07acac8f6892 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:44.898659 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-48ee1c8d-b06b-4c65-a284-07acac8f6892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:44.907776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:44.946067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150048c-79ec-48b7-bb54-e9f7349fa692 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:44.958149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150048c-79ec-48b7-bb54-e9f7349fa692 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:44.962245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858313a-faab-4291-9fb0-532473b43025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:44.962900 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858313a-faab-4291-9fb0-532473b43025 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:44.963176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858313a-faab-4291-9fb0-532473b43025 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:44.963446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858313a-faab-4291-9fb0-532473b43025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:44.972803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858313a-faab-4291-9fb0-532473b43025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:44.974329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858313a-faab-4291-9fb0-532473b43025 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:44.983486 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 741/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:46:47.272806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81df652-d967-479e-acc3-ea724cfcd132 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:47.273782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81df652-d967-479e-acc3-ea724cfcd132 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:47.273782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81df652-d967-479e-acc3-ea724cfcd132 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:47.276709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 730/1471] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:46:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:47.282519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb9857-ceb7-44b7-9e15-19e28f12007a None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:47.283001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb9857-ceb7-44b7-9e15-19e28f12007a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:47.283001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb9857-ceb7-44b7-9e15-19e28f12007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:47.302306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0eeb9857-ceb7-44b7-9e15-19e28f12007a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:47.303471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0eeb9857-ceb7-44b7-9e15-19e28f12007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:47.312604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 742/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:46:47.352277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81df652-d967-479e-acc3-ea724cfcd132 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:47.363180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81df652-d967-479e-acc3-ea724cfcd132 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:47.367018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9e0cb-a9bd-43a4-91db-a44dda672048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:47.367653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e0cb-a9bd-43a4-91db-a44dda672048 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:47.367933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e0cb-a9bd-43a4-91db-a44dda672048 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:47.368206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e0cb-a9bd-43a4-91db-a44dda672048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:47.377483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9e0cb-a9bd-43a4-91db-a44dda672048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:47.378948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9e0cb-a9bd-43a4-91db-a44dda672048 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:47.388448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 731/1473] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:47:05.284451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720cff3-90a5-4993-a39e-988e8fe1af86 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:05.285415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720cff3-90a5-4993-a39e-988e8fe1af86 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:05.285415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720cff3-90a5-4993-a39e-988e8fe1af86 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:05.288288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 743/1474] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:47:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:05.294176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa389e98-5c25-4b4d-b28c-8567212b4903 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:05.294623 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa389e98-5c25-4b4d-b28c-8567212b4903 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:05.294722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa389e98-5c25-4b4d-b28c-8567212b4903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:05.314464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-fa389e98-5c25-4b4d-b28c-8567212b4903 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:05.315648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-fa389e98-5c25-4b4d-b28c-8567212b4903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:05.323996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 732/1475] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:47:05.380601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4b005-5d26-4436-8e04-f1e7e097f41d None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:05.380882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4b005-5d26-4436-8e04-f1e7e097f41d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:05.381150 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4b005-5d26-4436-8e04-f1e7e097f41d None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:05.382954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 744/1476] 10.222.0.20 () {54 vars in 961 bytes} [Fri Oct 28 19:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:05.387789 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d6d2-3de4-4806-9c73-e4060166d5d6 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:05.388078 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d6d2-3de4-4806-9c73-e4060166d5d6 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:05.388354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d6d2-3de4-4806-9c73-e4060166d5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:05.407800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c1f0d6d2-3de4-4806-9c73-e4060166d5d6 None None] MFA Rules not processed for user `f94515985e244af29f47a49c0dd415ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:05.408951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c1f0d6d2-3de4-4806-9c73-e4060166d5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:05.416950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 733/1477] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Oct 28 19:47:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:47:05.424260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4b005-5d26-4436-8e04-f1e7e097f41d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:05.435916 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4b005-5d26-4436-8e04-f1e7e097f41d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:05.440206 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ce45f-f094-4483-bb45-b09d58c7e597 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f94515985e244af29f47a49c0dd415ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:05.440826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce45f-f094-4483-bb45-b09d58c7e597 service glance] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:05.441103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce45f-f094-4483-bb45-b09d58c7e597 service glance] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:05.441370 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce45f-f094-4483-bb45-b09d58c7e597 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:05.450324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ce45f-f094-4483-bb45-b09d58c7e597 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:05.451747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ce45f-f094-4483-bb45-b09d58c7e597 service glance] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:05.460903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 745/1478] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:47:07.837028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670dc1-2f56-44ce-ae12-13175f83a8a7 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:07.837538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670dc1-2f56-44ce-ae12-13175f83a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:07.837538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c670dc1-2f56-44ce-ae12-13175f83a8a7 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:07.839391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 734/1479] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:07.845712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302e266-45a3-45aa-ab90-8b48187a1d37 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:07.846465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302e266-45a3-45aa-ab90-8b48187a1d37 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:07.846664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302e266-45a3-45aa-ab90-8b48187a1d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:07.869946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d302e266-45a3-45aa-ab90-8b48187a1d37 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:07.871176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d302e266-45a3-45aa-ab90-8b48187a1d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:07.879799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 746/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:47:07.902920 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c670dc1-2f56-44ce-ae12-13175f83a8a7 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:07.916699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c670dc1-2f56-44ce-ae12-13175f83a8a7 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:07.921888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e2396-f1cd-40d1-b626-8dcc48c7a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:07.922556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e2396-f1cd-40d1-b626-8dcc48c7a78e admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:07.922830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e2396-f1cd-40d1-b626-8dcc48c7a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:07.923098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e2396-f1cd-40d1-b626-8dcc48c7a78e admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:07.923834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e2396-f1cd-40d1-b626-8dcc48c7a78e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:07.925679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e2396-f1cd-40d1-b626-8dcc48c7a78e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:07.940514 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 735/1481] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:07 2022] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:47:10.255538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a317d2-5c6a-4416-a8e9-1524fb3a6c6c None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:10.256129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a317d2-5c6a-4416-a8e9-1524fb3a6c6c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:10.256129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a317d2-5c6a-4416-a8e9-1524fb3a6c6c None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:10.257910 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 747/1482] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:10.264390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f24c-8dc0-4f6d-9bf7-4383a81be409 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:10.265072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f24c-8dc0-4f6d-9bf7-4383a81be409 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:10.265184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f24c-8dc0-4f6d-9bf7-4383a81be409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:10.283193 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0065f24c-8dc0-4f6d-9bf7-4383a81be409 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:10.284364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0065f24c-8dc0-4f6d-9bf7-4383a81be409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:10.293222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 736/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:47:10.340020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a317d2-5c6a-4416-a8e9-1524fb3a6c6c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:10.355546 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a317d2-5c6a-4416-a8e9-1524fb3a6c6c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:10.362221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c232fd-4f64-4f88-a34e-84cb0ed276eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:10.362892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c232fd-4f64-4f88-a34e-84cb0ed276eb service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:10.363174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c232fd-4f64-4f88-a34e-84cb0ed276eb service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:10.363446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c232fd-4f64-4f88-a34e-84cb0ed276eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:10.371842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c232fd-4f64-4f88-a34e-84cb0ed276eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:10.373468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c232fd-4f64-4f88-a34e-84cb0ed276eb service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:10.382972 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 748/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:47:12.867467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900e79a-2bf5-4f37-8219-6bf27617e619 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:12.868358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900e79a-2bf5-4f37-8219-6bf27617e619 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:12.868358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900e79a-2bf5-4f37-8219-6bf27617e619 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:12.871215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 737/1485] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:47:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:12.878805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cfbbc-8e06-4eda-b80d-5c6ff92c87cf None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:12.879243 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cfbbc-8e06-4eda-b80d-5c6ff92c87cf None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:12.879393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cfbbc-8e06-4eda-b80d-5c6ff92c87cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:12.906476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-532cfbbc-8e06-4eda-b80d-5c6ff92c87cf None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:12.907583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-532cfbbc-8e06-4eda-b80d-5c6ff92c87cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:12.917227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 749/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:47:12.955513 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900e79a-2bf5-4f37-8219-6bf27617e619 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:12.968571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900e79a-2bf5-4f37-8219-6bf27617e619 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:12.973884 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2d8d8-af9f-4e78-82e0-d9a52c22d4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:12.974863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d8d8-af9f-4e78-82e0-d9a52c22d4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:12.975199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d8d8-af9f-4e78-82e0-d9a52c22d4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:12.975563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d8d8-af9f-4e78-82e0-d9a52c22d4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:12.986769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d8d8-af9f-4e78-82e0-d9a52c22d4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:12.988218 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d8d8-af9f-4e78-82e0-d9a52c22d4f5 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:12.997961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 738/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:47:15.327641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adec5d-ff66-4e38-9fb4-98730a1126b5 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:15.328231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adec5d-ff66-4e38-9fb4-98730a1126b5 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:15.328231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adec5d-ff66-4e38-9fb4-98730a1126b5 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:15.329961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 750/1488] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:15.336124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766db533-a214-48ac-a09f-f48d3df435a3 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:15.336560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766db533-a214-48ac-a09f-f48d3df435a3 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:15.336640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766db533-a214-48ac-a09f-f48d3df435a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:15.362725 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-766db533-a214-48ac-a09f-f48d3df435a3 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:15.363900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-766db533-a214-48ac-a09f-f48d3df435a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:15.372176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 739/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:47:15.410322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adec5d-ff66-4e38-9fb4-98730a1126b5 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:15.422873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adec5d-ff66-4e38-9fb4-98730a1126b5 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:15.426649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571d3d8-1314-4cf9-8e39-ba7b3e5f8352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:15.427290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571d3d8-1314-4cf9-8e39-ba7b3e5f8352 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:15.427571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571d3d8-1314-4cf9-8e39-ba7b3e5f8352 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:15.427844 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571d3d8-1314-4cf9-8e39-ba7b3e5f8352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:15.437592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571d3d8-1314-4cf9-8e39-ba7b3e5f8352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:15.439073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571d3d8-1314-4cf9-8e39-ba7b3e5f8352 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:15.448960 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 751/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:47:17.893451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77e53-b7f4-4809-ba01-df53a854a9a0 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:17.893991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77e53-b7f4-4809-ba01-df53a854a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:17.893991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77e53-b7f4-4809-ba01-df53a854a9a0 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:17.896358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 740/1491] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:47:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:17.904907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fe890-0156-4a2b-81eb-03435242a958 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:17.905333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fe890-0156-4a2b-81eb-03435242a958 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:17.905464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fe890-0156-4a2b-81eb-03435242a958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:17.924973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-e43fe890-0156-4a2b-81eb-03435242a958 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:17.926221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e43fe890-0156-4a2b-81eb-03435242a958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:17.935364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 752/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:47:17.975504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c77e53-b7f4-4809-ba01-df53a854a9a0 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:17.987395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c77e53-b7f4-4809-ba01-df53a854a9a0 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:17.991121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18366211-7884-4813-8f5c-ec662e556f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:17.991755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18366211-7884-4813-8f5c-ec662e556f64 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:17.992038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18366211-7884-4813-8f5c-ec662e556f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:17.992312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18366211-7884-4813-8f5c-ec662e556f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:18.001944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18366211-7884-4813-8f5c-ec662e556f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:18.003423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18366211-7884-4813-8f5c-ec662e556f64 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:18.012903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 741/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:47:20.484195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43888-14c0-4e21-9ac1-1df80912ae8e None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:20.484792 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43888-14c0-4e21-9ac1-1df80912ae8e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:20.484792 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43888-14c0-4e21-9ac1-1df80912ae8e None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:20.486576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 753/1494] 10.222.0.20 () {54 vars in 926 bytes} [Fri Oct 28 19:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:20.492827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecb1e3-f664-4170-9248-edd0c995176e None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:20.493539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecb1e3-f664-4170-9248-edd0c995176e None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:20.493713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecb1e3-f664-4170-9248-edd0c995176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:20.519912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-eaecb1e3-f664-4170-9248-edd0c995176e None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:20.521106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-eaecb1e3-f664-4170-9248-edd0c995176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:20.529856 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 742/1495] 10.222.0.20 () {58 vars in 1023 bytes} [Fri Oct 28 19:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:47:20.568370 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43888-14c0-4e21-9ac1-1df80912ae8e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:20.581506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43888-14c0-4e21-9ac1-1df80912ae8e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:20.586042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59342975-2376-4ce3-a4f5-6394b3c23faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:20.586705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59342975-2376-4ce3-a4f5-6394b3c23faa service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:20.586978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59342975-2376-4ce3-a4f5-6394b3c23faa service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:20.587247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59342975-2376-4ce3-a4f5-6394b3c23faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:20.596578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59342975-2376-4ce3-a4f5-6394b3c23faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:20.598021 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59342975-2376-4ce3-a4f5-6394b3c23faa service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:20.607463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 754/1496] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:48:41.919596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6c825-1653-4d07-bd0f-0b5c09516f85 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:41.920378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6c825-1653-4d07-bd0f-0b5c09516f85 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:41.920576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6c825-1653-4d07-bd0f-0b5c09516f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:41.945214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-dfd6c825-1653-4d07-bd0f-0b5c09516f85 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:48:41.946425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-dfd6c825-1653-4d07-bd0f-0b5c09516f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:48:41.955277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 743/1497] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:48:41.968089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52d1b-4ca6-4c8e-a0cf-b5fcf0314509 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:41.968634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52d1b-4ca6-4c8e-a0cf-b5fcf0314509 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:41.968634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52d1b-4ca6-4c8e-a0cf-b5fcf0314509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:41.988220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-75e52d1b-4ca6-4c8e-a0cf-b5fcf0314509 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:48:41.989416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-75e52d1b-4ca6-4c8e-a0cf-b5fcf0314509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:48:41.997766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 755/1498] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:48:42.003185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6c825-1653-4d07-bd0f-0b5c09516f85 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:42.018169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6c825-1653-4d07-bd0f-0b5c09516f85 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:48:42.026689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fe731-5917-4515-8b60-8e45137fa71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:48:42.027663 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fe731-5917-4515-8b60-8e45137fa71a admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.028063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fe731-5917-4515-8b60-8e45137fa71a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.028452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fe731-5917-4515-8b60-8e45137fa71a admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.029576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fe731-5917-4515-8b60-8e45137fa71a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:48:42.029958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fe731-5917-4515-8b60-8e45137fa71a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:48:42.031474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING py.warnings [None req-da0fe731-5917-4515-8b60-8e45137fa71a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:48:42.031474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: warnings.warn(msg) Oct 28 19:48:42.031474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: Oct 28 19:48:42.032583 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fe731-5917-4515-8b60-8e45137fa71a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:48:42.044477 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 744/1499] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:48:42.052862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52d1b-4ca6-4c8e-a0cf-b5fcf0314509 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:42.062419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52d1b-4ca6-4c8e-a0cf-b5fcf0314509 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:48:42.067928 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31dc06-4648-4e46-a127-c662781e8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:48:42.068572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31dc06-4648-4e46-a127-c662781e8664 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.068859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31dc06-4648-4e46-a127-c662781e8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.069095 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31dc06-4648-4e46-a127-c662781e8664 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.069815 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31dc06-4648-4e46-a127-c662781e8664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:48:42.071565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING py.warnings [None req-ad31dc06-4648-4e46-a127-c662781e8664 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:48:42.071565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: warnings.warn(msg) Oct 28 19:48:42.071565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: Oct 28 19:48:42.072796 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31dc06-4648-4e46-a127-c662781e8664 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:48:42.111819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 756/1500] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:48:42 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:48:42.116145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fe731-5917-4515-8b60-8e45137fa71a admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:42.126016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fe731-5917-4515-8b60-8e45137fa71a admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:48:42.182957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f9fe1-b540-4f40-97a1-fc03c37c2b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:48:42.183563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f9fe1-b540-4f40-97a1-fc03c37c2b59 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.183825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f9fe1-b540-4f40-97a1-fc03c37c2b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.184097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f9fe1-b540-4f40-97a1-fc03c37c2b59 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.184789 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f9fe1-b540-4f40-97a1-fc03c37c2b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:48:42.185814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING py.warnings [None req-1e4f9fe1-b540-4f40-97a1-fc03c37c2b59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:48:42.185814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: warnings.warn(msg) Oct 28 19:48:42.185814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: Oct 28 19:48:42.187047 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f9fe1-b540-4f40-97a1-fc03c37c2b59 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:48:42.212311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 745/1501] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:48:42 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:48:42.216501 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31dc06-4648-4e46-a127-c662781e8664 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:42.229211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31dc06-4648-4e46-a127-c662781e8664 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:48:42.236778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46355a-acd9-4615-b31b-0d66427e724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:48:42.237434 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46355a-acd9-4615-b31b-0d66427e724c admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.237713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46355a-acd9-4615-b31b-0d66427e724c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.237978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46355a-acd9-4615-b31b-0d66427e724c admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.238734 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46355a-acd9-4615-b31b-0d66427e724c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:48:42.239754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING py.warnings [None req-cf46355a-acd9-4615-b31b-0d66427e724c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:48:42.239754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: warnings.warn(msg) Oct 28 19:48:42.239754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: Oct 28 19:48:42.240628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46355a-acd9-4615-b31b-0d66427e724c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:48:42.253737 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 757/1502] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:48:42.257814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f9fe1-b540-4f40-97a1-fc03c37c2b59 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:42.268179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f9fe1-b540-4f40-97a1-fc03c37c2b59 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:48:42.273157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0fcd8-c639-491f-a283-cded6ee72912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:48:42.273805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0fcd8-c639-491f-a283-cded6ee72912 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.274059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0fcd8-c639-491f-a283-cded6ee72912 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.274378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0fcd8-c639-491f-a283-cded6ee72912 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.275109 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0fcd8-c639-491f-a283-cded6ee72912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:48:42.276119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING py.warnings [None req-e3b0fcd8-c639-491f-a283-cded6ee72912 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:48:42.276119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: warnings.warn(msg) Oct 28 19:48:42.276119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: Oct 28 19:48:42.276992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0fcd8-c639-491f-a283-cded6ee72912 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:48:42.290562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 746/1503] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:48:42.295192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46355a-acd9-4615-b31b-0d66427e724c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:42.306225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46355a-acd9-4615-b31b-0d66427e724c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:48:42.311226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909cde7-fa18-4298-9a16-e16971338ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:48:42.312196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909cde7-fa18-4298-9a16-e16971338ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.312473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909cde7-fa18-4298-9a16-e16971338ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.312739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909cde7-fa18-4298-9a16-e16971338ca4 admin admin] PATH_INFO: `/v3/projects/616a138cedb7408d9059d4912f22f296/users/1dc09a395a2f420a9761fbc47e3fd493/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.328816 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909cde7-fa18-4298-9a16-e16971338ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616a138cedb7408d9059d4912f22f296, user_id=1dc09a395a2f420a9761fbc47e3fd493, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:48:42.329945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING py.warnings [None req-8909cde7-fa18-4298-9a16-e16971338ca4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:48:42.329945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: warnings.warn(msg) Oct 28 19:48:42.329945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: Oct 28 19:48:42.331908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909cde7-fa18-4298-9a16-e16971338ca4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:48:42.346761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 758/1504] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:48:42 2022] PUT /identity/v3/projects/616a138cedb7408d9059d4912f22f296/users/1dc09a395a2f420a9761fbc47e3fd493/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:48:42.359126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e5a0-a266-4107-b8d0-8c114d931ce1 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.359405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e5a0-a266-4107-b8d0-8c114d931ce1 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.359679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e5a0-a266-4107-b8d0-8c114d931ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.385995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c594e5a0-a266-4107-b8d0-8c114d931ce1 None None] MFA Rules not processed for user `1dc09a395a2f420a9761fbc47e3fd493`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:48:42.387237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c594e5a0-a266-4107-b8d0-8c114d931ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:48:42.458164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 747/1505] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:48:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:48:42.471836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21eecc-b9fe-41e9-a57c-d2a869f08e99 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.472123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21eecc-b9fe-41e9-a57c-d2a869f08e99 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.472395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21eecc-b9fe-41e9-a57c-d2a869f08e99 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.474269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 759/1506] 10.222.0.20 () {54 vars in 962 bytes} [Fri Oct 28 19:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:48:42.479296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007738bb-3864-4c55-ae1c-cd03692c3544 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.479578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007738bb-3864-4c55-ae1c-cd03692c3544 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.479852 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007738bb-3864-4c55-ae1c-cd03692c3544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.498701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-007738bb-3864-4c55-ae1c-cd03692c3544 None None] MFA Rules not processed for user `ba2e2211f5d14ebcbd0221278248b868`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:48:42.499864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-007738bb-3864-4c55-ae1c-cd03692c3544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:48:42.553367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 748/1507] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Oct 28 19:48:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:48:42.563069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21eecc-b9fe-41e9-a57c-d2a869f08e99 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:42.574583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21eecc-b9fe-41e9-a57c-d2a869f08e99 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:48:42.578502 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faea640-8793-49b5-8701-79fc39332585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:48:42.579131 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faea640-8793-49b5-8701-79fc39332585 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.579413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faea640-8793-49b5-8701-79fc39332585 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.579690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faea640-8793-49b5-8701-79fc39332585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.588803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faea640-8793-49b5-8701-79fc39332585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:48:42.590270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faea640-8793-49b5-8701-79fc39332585 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:48:42.599520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 760/1508] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:48:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:48:42.645283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478fc15-1f40-4176-9034-c87a1fa34b12 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.645575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478fc15-1f40-4176-9034-c87a1fa34b12 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.645858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478fc15-1f40-4176-9034-c87a1fa34b12 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.647599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 749/1509] 10.222.0.20 () {52 vars in 830 bytes} [Fri Oct 28 19:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:48:42.651366 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faea640-8793-49b5-8701-79fc39332585 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:42.716455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faea640-8793-49b5-8701-79fc39332585 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:48:42.722117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:48:42.723002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.723280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.723541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] PATH_INFO: `/v3/users/1dc09a395a2f420a9761fbc47e3fd493` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.724894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc09a395a2f420a9761fbc47e3fd493)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:48:42.725935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING py.warnings [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:48:42.725935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: warnings.warn(msg) Oct 28 19:48:42.725935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: Oct 28 19:48:42.727174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:48:42.795404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc09a395a2f420a9761fbc47e3fd493'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:48:42.813624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc09a395a2f420a9761fbc47e3fd493'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:48:42.814410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc09a395a2f420a9761fbc47e3fd493'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:48:42.815047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc09a395a2f420a9761fbc47e3fd493'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:48:42.825236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc09a395a2f420a9761fbc47e3fd493'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:48:42.845435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 761/1510] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:48:42 2022] DELETE /identity/v3/users/1dc09a395a2f420a9761fbc47e3fd493 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:48:42.850113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2bdce-e93b-42fa-8219-457cfc4fb799 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:42.850413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2bdce-e93b-42fa-8219-457cfc4fb799 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:42.850689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2bdce-e93b-42fa-8219-457cfc4fb799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:42.868712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-35d2bdce-e93b-42fa-8219-457cfc4fb799 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:48:42.869913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-35d2bdce-e93b-42fa-8219-457cfc4fb799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:48:42.930389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 750/1511] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:48:42.944013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:42.946156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:48:43.011627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39cd5d-5990-415c-938d-9a04dafcfc87 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:48:43.016338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030b57-bda5-4786-9e9f-5903e4fd3474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:48:43.016986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030b57-bda5-4786-9e9f-5903e4fd3474 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:43.017269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030b57-bda5-4786-9e9f-5903e4fd3474 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:43.017545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030b57-bda5-4786-9e9f-5903e4fd3474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:43.027296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030b57-bda5-4786-9e9f-5903e4fd3474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:48:43.028738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030b57-bda5-4786-9e9f-5903e4fd3474 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:48:43.038646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 762/1512] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:48:43.381733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2bdce-e93b-42fa-8219-457cfc4fb799 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:43.383350 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-35d2bdce-e93b-42fa-8219-457cfc4fb799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:48:43.394871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2bdce-e93b-42fa-8219-457cfc4fb799 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:48:43.399445 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:48:43.400338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:43.400609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:43.400868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] PATH_INFO: `/v3/projects/616a138cedb7408d9059d4912f22f296` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:43.402028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=616a138cedb7408d9059d4912f22f296)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:48:43.403196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING py.warnings [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:48:43.403196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: warnings.warn(msg) Oct 28 19:48:43.403196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: Oct 28 19:48:43.404240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:48:43.462931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616a138cedb7408d9059d4912f22f296', 'request_id': 'req-5a2ef527-f612-4b41-8045-d0839a145b71'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:48:43.476100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616a138cedb7408d9059d4912f22f296', 'request_id': 'req-5a2ef527-f612-4b41-8045-d0839a145b71'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:48:43.487681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616a138cedb7408d9059d4912f22f296', 'request_id': 'req-5a2ef527-f612-4b41-8045-d0839a145b71'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:48:43.502575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] The token cache is being invalidate because project 616a138cedb7408d9059d4912f22f296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:48:43.502856 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:48:43.503581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a2ef527-f612-4b41-8045-d0839a145b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:48:43.505185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 751/1513] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:48:43 2022] DELETE /identity/v3/projects/616a138cedb7408d9059d4912f22f296 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:50:15.108671 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407aad2-e867-4245-adee-91c291118222 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:15.109293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407aad2-e867-4245-adee-91c291118222 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:15.109293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407aad2-e867-4245-adee-91c291118222 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:15.112074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:50:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:15.119827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221901-abf8-44de-a1cc-a3b5a4cbdfb4 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:15.120323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221901-abf8-44de-a1cc-a3b5a4cbdfb4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:15.120323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221901-abf8-44de-a1cc-a3b5a4cbdfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:15.140334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-74221901-abf8-44de-a1cc-a3b5a4cbdfb4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:15.141546 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-74221901-abf8-44de-a1cc-a3b5a4cbdfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:15.206250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:50:15.363594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407aad2-e867-4245-adee-91c291118222 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:15.365554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e407aad2-e867-4245-adee-91c291118222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:15.456583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407aad2-e867-4245-adee-91c291118222 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:15.462731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408359-44a5-48a9-825f-c078a062d494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:15.463372 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408359-44a5-48a9-825f-c078a062d494 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:15.463643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408359-44a5-48a9-825f-c078a062d494 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:15.463908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408359-44a5-48a9-825f-c078a062d494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:15.472372 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408359-44a5-48a9-825f-c078a062d494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:15.473965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408359-44a5-48a9-825f-c078a062d494 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:15.483619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 764/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:16.117196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e27f2f-1127-4e5f-8718-b315b5119da9 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:16.117548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e27f2f-1127-4e5f-8718-b315b5119da9 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:16.117825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e27f2f-1127-4e5f-8718-b315b5119da9 None None] PATH_INFO: `/v3` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:16.119182 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 753/1517] 10.222.0.55 () {54 vars in 925 bytes} [Fri Oct 28 19:50:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:50:16.126415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8c96-fd1e-4684-932d-7e6b13662843 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:16.126889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8c96-fd1e-4684-932d-7e6b13662843 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:16.127002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8c96-fd1e-4684-932d-7e6b13662843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:16.146029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f25d8c96-fd1e-4684-932d-7e6b13662843 None None] MFA Rules not processed for user `4e04cc7f60894946aace79d4c2875f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:16.147244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f25d8c96-fd1e-4684-932d-7e6b13662843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:16.213190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 765/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Fri Oct 28 19:50:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:16.800000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203e5c5-82e2-4f5f-b807-fa74e8c5ff4d None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:16.800497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203e5c5-82e2-4f5f-b807-fa74e8c5ff4d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:16.800497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203e5c5-82e2-4f5f-b807-fa74e8c5ff4d None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:16.803252 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 754/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:50:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:16.810891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e6bd-70d6-42fb-b431-a37cda0f4b2a None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:16.811309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e6bd-70d6-42fb-b431-a37cda0f4b2a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:16.811711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e6bd-70d6-42fb-b431-a37cda0f4b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:16.836934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-9474e6bd-70d6-42fb-b431-a37cda0f4b2a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:16.838131 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9474e6bd-70d6-42fb-b431-a37cda0f4b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:16.847400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 766/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:17.000335 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203e5c5-82e2-4f5f-b807-fa74e8c5ff4d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:17.015557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203e5c5-82e2-4f5f-b807-fa74e8c5ff4d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:17.020360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab26989-a218-4136-bd91-1886a8c0d631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:17.021010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab26989-a218-4136-bd91-1886a8c0d631 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:17.021297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab26989-a218-4136-bd91-1886a8c0d631 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:17.021575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab26989-a218-4136-bd91-1886a8c0d631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:17.030021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab26989-a218-4136-bd91-1886a8c0d631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:17.031655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab26989-a218-4136-bd91-1886a8c0d631 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:17.041041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 755/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:50:20.121262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6b4c1-618c-4ea9-9722-3beadd3c8f94 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:20.121803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6b4c1-618c-4ea9-9722-3beadd3c8f94 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:20.121803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6b4c1-618c-4ea9-9722-3beadd3c8f94 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:20.123640 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 767/1522] 10.222.0.20 () {54 vars in 960 bytes} [Fri Oct 28 19:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:20.129837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f2560-2c60-468e-ad34-69e40673b374 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:20.130596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f2560-2c60-468e-ad34-69e40673b374 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:20.130789 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f2560-2c60-468e-ad34-69e40673b374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:20.158410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d46f2560-2c60-468e-ad34-69e40673b374 None None] MFA Rules not processed for user `4e04cc7f60894946aace79d4c2875f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:20.159609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d46f2560-2c60-468e-ad34-69e40673b374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:20.169645 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 756/1523] 10.222.0.20 () {58 vars in 1057 bytes} [Fri Oct 28 19:50:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:20.177329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6b4c1-618c-4ea9-9722-3beadd3c8f94 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:20.192462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6b4c1-618c-4ea9-9722-3beadd3c8f94 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:20.198750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2b083-f2bd-47bc-bcf2-263990e0fb03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:20.199394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2b083-f2bd-47bc-bcf2-263990e0fb03 service placement] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:20.199671 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2b083-f2bd-47bc-bcf2-263990e0fb03 service placement] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:20.199941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2b083-f2bd-47bc-bcf2-263990e0fb03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:20.208220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2b083-f2bd-47bc-bcf2-263990e0fb03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:20.209800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2b083-f2bd-47bc-bcf2-263990e0fb03 service placement] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:20.219275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 768/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:28.760828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657f1d3-f425-463a-a251-20d9abcabaaa None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:28.761720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657f1d3-f425-463a-a251-20d9abcabaaa None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:28.761926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657f1d3-f425-463a-a251-20d9abcabaaa None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:28.764521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:50:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:28.772824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e229abd-5d0a-4ab9-aeb8-59f573a8f901 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:28.773522 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e229abd-5d0a-4ab9-aeb8-59f573a8f901 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:28.773668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e229abd-5d0a-4ab9-aeb8-59f573a8f901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:28.800650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6e229abd-5d0a-4ab9-aeb8-59f573a8f901 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:28.801865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6e229abd-5d0a-4ab9-aeb8-59f573a8f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:28.810163 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:28.960205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657f1d3-f425-463a-a251-20d9abcabaaa None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:28.977597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657f1d3-f425-463a-a251-20d9abcabaaa None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:28.984291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654fcfe-260e-4a0b-94ac-5a03fa5ebe50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:28.984926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654fcfe-260e-4a0b-94ac-5a03fa5ebe50 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:28.985203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654fcfe-260e-4a0b-94ac-5a03fa5ebe50 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:28.985473 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654fcfe-260e-4a0b-94ac-5a03fa5ebe50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:28.993753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654fcfe-260e-4a0b-94ac-5a03fa5ebe50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:28.995384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654fcfe-260e-4a0b-94ac-5a03fa5ebe50 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:29.007487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 758/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:30.293909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e778c-f868-4165-9713-9d4dc694f05c None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:30.294541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e778c-f868-4165-9713-9d4dc694f05c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:30.294541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e778c-f868-4165-9713-9d4dc694f05c None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:30.296362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:30.302560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bafb-b738-4b98-a29e-d47d846148f2 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:30.303020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bafb-b738-4b98-a29e-d47d846148f2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:30.303116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bafb-b738-4b98-a29e-d47d846148f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:30.331210 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1547bafb-b738-4b98-a29e-d47d846148f2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:30.332415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1547bafb-b738-4b98-a29e-d47d846148f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:30.341462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:30.493738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e778c-f868-4165-9713-9d4dc694f05c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:30.516863 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e778c-f868-4165-9713-9d4dc694f05c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:30.523314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf70e1a-f4e1-4ffa-8c8e-514a926a1f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:30.523925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf70e1a-f4e1-4ffa-8c8e-514a926a1f9f service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:30.524205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf70e1a-f4e1-4ffa-8c8e-514a926a1f9f service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:30.524473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf70e1a-f4e1-4ffa-8c8e-514a926a1f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:30.532890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf70e1a-f4e1-4ffa-8c8e-514a926a1f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:30.534524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf70e1a-f4e1-4ffa-8c8e-514a926a1f9f service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:30.544628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 771/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:34.582355 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d347-876d-4a28-928a-7c94c3f1dadb None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:34.582979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d347-876d-4a28-928a-7c94c3f1dadb None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:34.582979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d347-876d-4a28-928a-7c94c3f1dadb None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:34.584681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:34.590292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3d54-ad63-433b-b4e1-cc14a9b3df7d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:34.590770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3d54-ad63-433b-b4e1-cc14a9b3df7d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:34.590903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a3d54-ad63-433b-b4e1-cc14a9b3df7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:34.609790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-370a3d54-ad63-433b-b4e1-cc14a9b3df7d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:34.610997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-370a3d54-ad63-433b-b4e1-cc14a9b3df7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:34.619981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:34.658147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d347-876d-4a28-928a-7c94c3f1dadb None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:34.660990 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7b71d347-876d-4a28-928a-7c94c3f1dadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:34.729243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d347-876d-4a28-928a-7c94c3f1dadb None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:34.733408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c00a3-f95c-48a7-972c-8e459ef56675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:34.734170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c00a3-f95c-48a7-972c-8e459ef56675 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:34.734465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c00a3-f95c-48a7-972c-8e459ef56675 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:34.734722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c00a3-f95c-48a7-972c-8e459ef56675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:34.743747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c00a3-f95c-48a7-972c-8e459ef56675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:34.745174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c00a3-f95c-48a7-972c-8e459ef56675 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:34.755856 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 761/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:37.045515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127e26-9302-4176-9f3f-a95d4a5ef4b7 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:37.046128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127e26-9302-4176-9f3f-a95d4a5ef4b7 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:37.046128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127e26-9302-4176-9f3f-a95d4a5ef4b7 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:37.047917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:37.053292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f131cdd-43ec-4649-a9f6-07dc7ccdff10 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:37.053735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f131cdd-43ec-4649-a9f6-07dc7ccdff10 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:37.053836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f131cdd-43ec-4649-a9f6-07dc7ccdff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:37.073939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-8f131cdd-43ec-4649-a9f6-07dc7ccdff10 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:37.075141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8f131cdd-43ec-4649-a9f6-07dc7ccdff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:37.085413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:37.124406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127e26-9302-4176-9f3f-a95d4a5ef4b7 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:37.126274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c5127e26-9302-4176-9f3f-a95d4a5ef4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:37.139711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127e26-9302-4176-9f3f-a95d4a5ef4b7 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:37.143612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f19d0b-3a85-40e9-9d4a-2f0f41fc01b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:37.144241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f19d0b-3a85-40e9-9d4a-2f0f41fc01b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:37.144523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f19d0b-3a85-40e9-9d4a-2f0f41fc01b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:37.144795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f19d0b-3a85-40e9-9d4a-2f0f41fc01b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:37.153849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f19d0b-3a85-40e9-9d4a-2f0f41fc01b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:37.155346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f19d0b-3a85-40e9-9d4a-2f0f41fc01b8 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:37.164969 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 774/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:41.126707 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682dc2f-b70a-46a1-b3da-8caaf86b7ec0 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:41.127305 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682dc2f-b70a-46a1-b3da-8caaf86b7ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:41.127305 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682dc2f-b70a-46a1-b3da-8caaf86b7ec0 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:41.129046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:41.135516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14776766-5cd3-4ce2-b10a-a889d0dd8268 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:41.136236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14776766-5cd3-4ce2-b10a-a889d0dd8268 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:41.136373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14776766-5cd3-4ce2-b10a-a889d0dd8268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:41.163232 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-14776766-5cd3-4ce2-b10a-a889d0dd8268 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:41.164435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-14776766-5cd3-4ce2-b10a-a889d0dd8268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:41.174556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:41.427852 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682dc2f-b70a-46a1-b3da-8caaf86b7ec0 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:41.429920 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6682dc2f-b70a-46a1-b3da-8caaf86b7ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:41.488960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682dc2f-b70a-46a1-b3da-8caaf86b7ec0 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:41.492849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1204c-ff8e-4f2c-934d-7e2475aa6323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:41.493488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1204c-ff8e-4f2c-934d-7e2475aa6323 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:41.493767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1204c-ff8e-4f2c-934d-7e2475aa6323 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:41.494042 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1204c-ff8e-4f2c-934d-7e2475aa6323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:41.503243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1204c-ff8e-4f2c-934d-7e2475aa6323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:41.504672 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1204c-ff8e-4f2c-934d-7e2475aa6323 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:41.515145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 764/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:43.846964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d660-cca3-4586-a791-77bee4b0ec76 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:43.847556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d660-cca3-4586-a791-77bee4b0ec76 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:43.847556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d660-cca3-4586-a791-77bee4b0ec76 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:43.849313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 776/1540] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 19:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:43.854643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57c713-cf47-4d19-9e82-b8ec10140743 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:43.855087 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57c713-cf47-4d19-9e82-b8ec10140743 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:43.855201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57c713-cf47-4d19-9e82-b8ec10140743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:43.873994 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0c57c713-cf47-4d19-9e82-b8ec10140743 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:43.875260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0c57c713-cf47-4d19-9e82-b8ec10140743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:43.884962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 765/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 19:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:44.141336 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240d660-cca3-4586-a791-77bee4b0ec76 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:44.144624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4240d660-cca3-4586-a791-77bee4b0ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:44.163222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240d660-cca3-4586-a791-77bee4b0ec76 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:44.167431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a0513-6734-497c-bd52-8dd05ff1ca2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:44.168070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a0513-6734-497c-bd52-8dd05ff1ca2f service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:44.168352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a0513-6734-497c-bd52-8dd05ff1ca2f service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:44.168630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a0513-6734-497c-bd52-8dd05ff1ca2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:44.178421 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a0513-6734-497c-bd52-8dd05ff1ca2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:44.179863 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a0513-6734-497c-bd52-8dd05ff1ca2f service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:44.189379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 777/1542] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:23.494579 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe69897-c744-4dd5-93e5-03d03ba298ff None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.495243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe69897-c744-4dd5-93e5-03d03ba298ff None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.495243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe69897-c744-4dd5-93e5-03d03ba298ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.527538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ebe69897-c744-4dd5-93e5-03d03ba298ff None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:23.529131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ebe69897-c744-4dd5-93e5-03d03ba298ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:23.539043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 766/1543] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:23.548793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a659b0-7858-4dc1-ab30-7160fd4d3ec0 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.549428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a659b0-7858-4dc1-ab30-7160fd4d3ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.549428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a659b0-7858-4dc1-ab30-7160fd4d3ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.553115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762092a-a44e-4ee9-844a-8536608286e3 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.553458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762092a-a44e-4ee9-844a-8536608286e3 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.553674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762092a-a44e-4ee9-844a-8536608286e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.577318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b8a659b0-7858-4dc1-ab30-7160fd4d3ec0 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:23.578519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b8a659b0-7858-4dc1-ab30-7160fd4d3ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:23.587349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-7762092a-a44e-4ee9-844a-8536608286e3 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:23.589074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7762092a-a44e-4ee9-844a-8536608286e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:23.593070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 778/1544] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:52:23.598438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a659b0-7858-4dc1-ab30-7160fd4d3ec0 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:23.601582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 767/1545] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:23.609271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a659b0-7858-4dc1-ab30-7160fd4d3ec0 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:23.612269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a325-4d06-4515-9754-c210d7b246d0 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.612560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a325-4d06-4515-9754-c210d7b246d0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.612839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a325-4d06-4515-9754-c210d7b246d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.623884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a90e6d-91a2-471d-97d1-aa865adc7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:23.624748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a90e6d-91a2-471d-97d1-aa865adc7da0 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.625162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a90e6d-91a2-471d-97d1-aa865adc7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.625606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a90e6d-91a2-471d-97d1-aa865adc7da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.626405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a90e6d-91a2-471d-97d1-aa865adc7da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:23.626706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a90e6d-91a2-471d-97d1-aa865adc7da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:23.627732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING py.warnings [None req-26a90e6d-91a2-471d-97d1-aa865adc7da0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:52:23.627732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: warnings.warn(msg) Oct 28 19:52:23.627732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: Oct 28 19:52:23.628614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a90e6d-91a2-471d-97d1-aa865adc7da0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:23.650517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 779/1546] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:52:23.657289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a90e6d-91a2-471d-97d1-aa865adc7da0 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:23.663818 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e214a325-4d06-4515-9754-c210d7b246d0 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:23.665048 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e214a325-4d06-4515-9754-c210d7b246d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:23.679095 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a90e6d-91a2-471d-97d1-aa865adc7da0 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:23.685572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 768/1547] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:52:23.687060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218ae7d-0c9e-4823-a0a7-b403f6c0445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:23.687772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ae7d-0c9e-4823-a0a7-b403f6c0445a admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.688047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ae7d-0c9e-4823-a0a7-b403f6c0445a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.688322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ae7d-0c9e-4823-a0a7-b403f6c0445a admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.689230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218ae7d-0c9e-4823-a0a7-b403f6c0445a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:23.691644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218ae7d-0c9e-4823-a0a7-b403f6c0445a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:23.691860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214a325-4d06-4515-9754-c210d7b246d0 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:23.714775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214a325-4d06-4515-9754-c210d7b246d0 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:23.727044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6428f5-7292-4585-95ab-e91fbbd4260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:23.728229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6428f5-7292-4585-95ab-e91fbbd4260d admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.728716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6428f5-7292-4585-95ab-e91fbbd4260d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.729248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6428f5-7292-4585-95ab-e91fbbd4260d admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.730299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6428f5-7292-4585-95ab-e91fbbd4260d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:23.731164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6428f5-7292-4585-95ab-e91fbbd4260d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:23.733400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6428f5-7292-4585-95ab-e91fbbd4260d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:23.748540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 780/1548] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:52:23.750258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e1c5-3c23-4eb1-b6aa-8e365ffa0af1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.750541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e1c5-3c23-4eb1-b6aa-8e365ffa0af1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.750820 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e1c5-3c23-4eb1-b6aa-8e365ffa0af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.767243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 769/1549] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:52:23.768309 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6428f5-7292-4585-95ab-e91fbbd4260d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:23.793377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-83a9e1c5-3c23-4eb1-b6aa-8e365ffa0af1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:23.796651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6428f5-7292-4585-95ab-e91fbbd4260d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:23.797990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-83a9e1c5-3c23-4eb1-b6aa-8e365ffa0af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:23.875589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 781/1550] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:23.876405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e1c5-3c23-4eb1-b6aa-8e365ffa0af1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:23.883761 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b691d9a-a3ec-4148-a0b0-5a3c58e68872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:23.884888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b691d9a-a3ec-4148-a0b0-5a3c58e68872 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.885181 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b691d9a-a3ec-4148-a0b0-5a3c58e68872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.885438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b691d9a-a3ec-4148-a0b0-5a3c58e68872 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.886164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b691d9a-a3ec-4148-a0b0-5a3c58e68872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:23.887231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e1c5-3c23-4eb1-b6aa-8e365ffa0af1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:23.888120 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b691d9a-a3ec-4148-a0b0-5a3c58e68872 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:23.891802 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05274977-5cee-433b-9840-63dfe17c3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:23.892446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274977-5cee-433b-9840-63dfe17c3551 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.892722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274977-5cee-433b-9840-63dfe17c3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.892990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274977-5cee-433b-9840-63dfe17c3551 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.893670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05274977-5cee-433b-9840-63dfe17c3551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:23.895592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05274977-5cee-433b-9840-63dfe17c3551 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:23.909978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 770/1551] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:23.911713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc03c0b-f502-487c-a1b1-dc8c312766c8 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.911998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc03c0b-f502-487c-a1b1-dc8c312766c8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.912272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc03c0b-f502-487c-a1b1-dc8c312766c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.927509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 782/1552] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:23.928690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd474fe-3a15-449b-aef6-7b24ee722370 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.928986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd474fe-3a15-449b-aef6-7b24ee722370 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.929264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd474fe-3a15-449b-aef6-7b24ee722370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.936860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ddc03c0b-f502-487c-a1b1-dc8c312766c8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:23.938044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ddc03c0b-f502-487c-a1b1-dc8c312766c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:23.946073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fcd474fe-3a15-449b-aef6-7b24ee722370 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:23.947252 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fcd474fe-3a15-449b-aef6-7b24ee722370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:23.997748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 771/1553] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:23.999256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ff3e8-b650-47c4-8990-2a2818f78882 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.999486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ff3e8-b650-47c4-8990-2a2818f78882 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.999786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ff3e8-b650-47c4-8990-2a2818f78882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.016315 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 783/1554] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.017609 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2793b-c1de-406a-8adf-831d4bd786e6 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.017891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2793b-c1de-406a-8adf-831d4bd786e6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.018190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2793b-c1de-406a-8adf-831d4bd786e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.019204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-941ff3e8-b650-47c4-8990-2a2818f78882 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:24.020751 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-941ff3e8-b650-47c4-8990-2a2818f78882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:24.029735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 772/1555] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.031108 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d8c7c-6e75-4a07-8d7b-59df058fd5ab None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.031426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d8c7c-6e75-4a07-8d7b-59df058fd5ab None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.031719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d8c7c-6e75-4a07-8d7b-59df058fd5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.041785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-1af2793b-c1de-406a-8adf-831d4bd786e6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:24.043171 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1af2793b-c1de-406a-8adf-831d4bd786e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:24.050269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-6e0d8c7c-6e75-4a07-8d7b-59df058fd5ab None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:24.051428 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6e0d8c7c-6e75-4a07-8d7b-59df058fd5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:24.051894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 784/1556] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.058806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2793b-c1de-406a-8adf-831d4bd786e6 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.059330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 773/1557] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.060736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeedebf-6aab-45f4-b3d1-67ce625ba127 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.061014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeedebf-6aab-45f4-b3d1-67ce625ba127 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.061282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeedebf-6aab-45f4-b3d1-67ce625ba127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.062631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2793b-c1de-406a-8adf-831d4bd786e6 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.067778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf9382-4346-4f84-9df1-5e10d7f1bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.068434 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9382-4346-4f84-9df1-5e10d7f1bf5a admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.068711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9382-4346-4f84-9df1-5e10d7f1bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.068979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9382-4346-4f84-9df1-5e10d7f1bf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.069704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf9382-4346-4f84-9df1-5e10d7f1bf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.071377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf9382-4346-4f84-9df1-5e10d7f1bf5a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.078671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-efeedebf-6aab-45f4-b3d1-67ce625ba127 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:24.079821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-efeedebf-6aab-45f4-b3d1-67ce625ba127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:24.081613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 785/1558] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:24.082418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf9382-4346-4f84-9df1-5e10d7f1bf5a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.088515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 774/1559] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.089816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff02ca-7600-42c9-a4b3-5d233cc8c2da None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.090187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff02ca-7600-42c9-a4b3-5d233cc8c2da None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.090475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff02ca-7600-42c9-a4b3-5d233cc8c2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.093186 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf9382-4346-4f84-9df1-5e10d7f1bf5a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.098030 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618042a-6701-4c1e-bf83-7750703224f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.098709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618042a-6701-4c1e-bf83-7750703224f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.098986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618042a-6701-4c1e-bf83-7750703224f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.099255 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618042a-6701-4c1e-bf83-7750703224f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.099938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618042a-6701-4c1e-bf83-7750703224f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.100956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING py.warnings [None req-1618042a-6701-4c1e-bf83-7750703224f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:52:24.100956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: warnings.warn(msg) Oct 28 19:52:24.100956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: Oct 28 19:52:24.102184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618042a-6701-4c1e-bf83-7750703224f7 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.109199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-7fff02ca-7600-42c9-a4b3-5d233cc8c2da None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:24.110418 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7fff02ca-7600-42c9-a4b3-5d233cc8c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:24.119458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 775/1560] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.120844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd8626-f70e-4df3-8283-354fe966097c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.121128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd8626-f70e-4df3-8283-354fe966097c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.121422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd8626-f70e-4df3-8283-354fe966097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.123677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 786/1561] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.125281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f4b4-497c-4def-806f-40cb983982c1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.125551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f4b4-497c-4def-806f-40cb983982c1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.125834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f4b4-497c-4def-806f-40cb983982c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.139956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-10cd8626-f70e-4df3-8283-354fe966097c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:24.141131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-10cd8626-f70e-4df3-8283-354fe966097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:24.143101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-8ef8f4b4-497c-4def-806f-40cb983982c1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:24.144246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8ef8f4b4-497c-4def-806f-40cb983982c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:24.150424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 776/1562] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.151652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f74a-ad0e-4270-be0e-205104057533 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.151933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f74a-ad0e-4270-be0e-205104057533 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.152203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f74a-ad0e-4270-be0e-205104057533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.155463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 787/1563] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.156236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8f4b4-497c-4def-806f-40cb983982c1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.165534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8f4b4-497c-4def-806f-40cb983982c1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.169904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5ec90-548c-4895-8a66-379be2eed356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.170580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5ec90-548c-4895-8a66-379be2eed356 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.170975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5ec90-548c-4895-8a66-379be2eed356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.171212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5ec90-548c-4895-8a66-379be2eed356 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.171895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1247f74a-ad0e-4270-be0e-205104057533 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:24.171994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5ec90-548c-4895-8a66-379be2eed356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:24.172220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5ec90-548c-4895-8a66-379be2eed356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.173090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1247f74a-ad0e-4270-be0e-205104057533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:24.173813 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5ec90-548c-4895-8a66-379be2eed356 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.181114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 777/1564] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.181673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f74a-ad0e-4270-be0e-205104057533 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.189126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 788/1565] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:24.189126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b4633-bed5-4f4f-a2f4-d83409f04668 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.189126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b4633-bed5-4f4f-a2f4-d83409f04668 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.189126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b4633-bed5-4f4f-a2f4-d83409f04668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.193797 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f74a-ad0e-4270-be0e-205104057533 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.198718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02430c5-9597-406a-ab91-6ac2b4f9ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.199395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02430c5-9597-406a-ab91-6ac2b4f9ea5e admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.199640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02430c5-9597-406a-ab91-6ac2b4f9ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.199908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02430c5-9597-406a-ab91-6ac2b4f9ea5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.200663 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02430c5-9597-406a-ab91-6ac2b4f9ea5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.202401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02430c5-9597-406a-ab91-6ac2b4f9ea5e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.205304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b09b4633-bed5-4f4f-a2f4-d83409f04668 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:24.206519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b09b4633-bed5-4f4f-a2f4-d83409f04668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:24.212412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 778/1566] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:24.213255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02430c5-9597-406a-ab91-6ac2b4f9ea5e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.217726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 789/1567] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.218602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b4633-bed5-4f4f-a2f4-d83409f04668 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.222836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02430c5-9597-406a-ab91-6ac2b4f9ea5e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.227158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914461e-2598-4225-a7aa-b96584b5952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.227663 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b4633-bed5-4f4f-a2f4-d83409f04668 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.227779 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914461e-2598-4225-a7aa-b96584b5952b admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.228049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914461e-2598-4225-a7aa-b96584b5952b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.228320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914461e-2598-4225-a7aa-b96584b5952b admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.229023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914461e-2598-4225-a7aa-b96584b5952b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:24.229321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914461e-2598-4225-a7aa-b96584b5952b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.230937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914461e-2598-4225-a7aa-b96584b5952b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.232264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed996a0-5a0a-4a4f-a288-58ecda80a967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.232901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed996a0-5a0a-4a4f-a288-58ecda80a967 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.233176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed996a0-5a0a-4a4f-a288-58ecda80a967 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.233435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed996a0-5a0a-4a4f-a288-58ecda80a967 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.234222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed996a0-5a0a-4a4f-a288-58ecda80a967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.235789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed996a0-5a0a-4a4f-a288-58ecda80a967 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.242420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 779/1568] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:24.243397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914461e-2598-4225-a7aa-b96584b5952b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.245743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 790/1569] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:24.246436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed996a0-5a0a-4a4f-a288-58ecda80a967 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.255866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed996a0-5a0a-4a4f-a288-58ecda80a967 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.258420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914461e-2598-4225-a7aa-b96584b5952b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.260383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a2f87-4f0a-4e53-93b5-62561e15bdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.261150 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a2f87-4f0a-4e53-93b5-62561e15bdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.261438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a2f87-4f0a-4e53-93b5-62561e15bdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.261710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a2f87-4f0a-4e53-93b5-62561e15bdb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.262587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a2f87-4f0a-4e53-93b5-62561e15bdb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:24.262828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d83960-f127-420a-b613-3390e3dd6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.262935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a2f87-4f0a-4e53-93b5-62561e15bdb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.263465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83960-f127-420a-b613-3390e3dd6b91 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.263739 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83960-f127-420a-b613-3390e3dd6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.264011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83960-f127-420a-b613-3390e3dd6b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.264523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a2f87-4f0a-4e53-93b5-62561e15bdb4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.264737 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d83960-f127-420a-b613-3390e3dd6b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:24.265077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d83960-f127-420a-b613-3390e3dd6b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.266724 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d83960-f127-420a-b613-3390e3dd6b91 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.276740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 791/1570] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:24.277724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a2f87-4f0a-4e53-93b5-62561e15bdb4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.278156 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 780/1571] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:24.286447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d83960-f127-420a-b613-3390e3dd6b91 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.289187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a2f87-4f0a-4e53-93b5-62561e15bdb4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.294032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7923a-a5d5-4002-ab1e-72fb07e7848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.294747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7923a-a5d5-4002-ab1e-72fb07e7848f admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.295029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7923a-a5d5-4002-ab1e-72fb07e7848f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.295305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7923a-a5d5-4002-ab1e-72fb07e7848f admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.295744 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d83960-f127-420a-b613-3390e3dd6b91 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.296141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7923a-a5d5-4002-ab1e-72fb07e7848f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:24.296431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7923a-a5d5-4002-ab1e-72fb07e7848f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.298126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7923a-a5d5-4002-ab1e-72fb07e7848f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.300184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beaf5d-5148-4b76-b0d7-520af32b3166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.300814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beaf5d-5148-4b76-b0d7-520af32b3166 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.301090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beaf5d-5148-4b76-b0d7-520af32b3166 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.301357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beaf5d-5148-4b76-b0d7-520af32b3166 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.302035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beaf5d-5148-4b76-b0d7-520af32b3166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.303072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING py.warnings [None req-f8beaf5d-5148-4b76-b0d7-520af32b3166 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:52:24.303072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: warnings.warn(msg) Oct 28 19:52:24.303072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: Oct 28 19:52:24.304230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beaf5d-5148-4b76-b0d7-520af32b3166 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.309975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 792/1572] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:24.310635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7923a-a5d5-4002-ab1e-72fb07e7848f admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.319929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7923a-a5d5-4002-ab1e-72fb07e7848f admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.324879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2a3a2-aabe-4c1a-97ad-059344b35932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.325802 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2a3a2-aabe-4c1a-97ad-059344b35932 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.326097 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2a3a2-aabe-4c1a-97ad-059344b35932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.326396 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2a3a2-aabe-4c1a-97ad-059344b35932 admin admin] PATH_INFO: `/v3/projects/36f8887e8f7f4c038d11cb582b95c2e8/users/36c4bc5fb79b455fba3c684645fca939/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.331766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 781/1573] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.332840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beaf5d-5148-4b76-b0d7-520af32b3166 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.340973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2a3a2-aabe-4c1a-97ad-059344b35932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f8887e8f7f4c038d11cb582b95c2e8, user_id=36c4bc5fb79b455fba3c684645fca939, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.343733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2a3a2-aabe-4c1a-97ad-059344b35932 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.357202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 793/1574] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:24 2022] PUT /identity/v3/projects/36f8887e8f7f4c038d11cb582b95c2e8/users/36c4bc5fb79b455fba3c684645fca939/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:24.358059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2a3a2-aabe-4c1a-97ad-059344b35932 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.391461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beaf5d-5148-4b76-b0d7-520af32b3166 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.415733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2a3a2-aabe-4c1a-97ad-059344b35932 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.420213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c242be-0afd-4c03-98d8-9e6bff40ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.420881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c242be-0afd-4c03-98d8-9e6bff40ce2e admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.421240 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c242be-0afd-4c03-98d8-9e6bff40ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.421514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c242be-0afd-4c03-98d8-9e6bff40ce2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.422283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c242be-0afd-4c03-98d8-9e6bff40ce2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.423895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c242be-0afd-4c03-98d8-9e6bff40ce2e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.433505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 794/1575] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:24.434310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c242be-0afd-4c03-98d8-9e6bff40ce2e admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.444919 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7045979-e776-44dd-9467-b648db8f32f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.445086 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c242be-0afd-4c03-98d8-9e6bff40ce2e admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.445589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7045979-e776-44dd-9467-b648db8f32f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.445869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7045979-e776-44dd-9467-b648db8f32f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.446167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7045979-e776-44dd-9467-b648db8f32f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.446891 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7045979-e776-44dd-9467-b648db8f32f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:24.447204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7045979-e776-44dd-9467-b648db8f32f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.448810 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7045979-e776-44dd-9467-b648db8f32f4 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.449873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cee51-fc16-4765-a9eb-2f3ee42304a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.450544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cee51-fc16-4765-a9eb-2f3ee42304a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.450822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cee51-fc16-4765-a9eb-2f3ee42304a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.451094 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cee51-fc16-4765-a9eb-2f3ee42304a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.451784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cee51-fc16-4765-a9eb-2f3ee42304a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.453730 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cee51-fc16-4765-a9eb-2f3ee42304a6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.460200 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 782/1576] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:24.463037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7045979-e776-44dd-9467-b648db8f32f4 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.473589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7045979-e776-44dd-9467-b648db8f32f4 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.479052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fb93f-c399-4afb-bfde-ae2ccc2f71f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.479719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fb93f-c399-4afb-bfde-ae2ccc2f71f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.479986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fb93f-c399-4afb-bfde-ae2ccc2f71f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.480078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 795/1577] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.480258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fb93f-c399-4afb-bfde-ae2ccc2f71f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.480803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cee51-fc16-4765-a9eb-2f3ee42304a6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.480946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fb93f-c399-4afb-bfde-ae2ccc2f71f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.482920 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fb93f-c399-4afb-bfde-ae2ccc2f71f7 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.516110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 783/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.516110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fb93f-c399-4afb-bfde-ae2ccc2f71f7 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.544177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cee51-fc16-4765-a9eb-2f3ee42304a6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.574726 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fb93f-c399-4afb-bfde-ae2ccc2f71f7 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.579907 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2501b20-5dbf-4c52-b58e-1babbf7d3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.580642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2501b20-5dbf-4c52-b58e-1babbf7d3fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.580858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2501b20-5dbf-4c52-b58e-1babbf7d3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.581150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2501b20-5dbf-4c52-b58e-1babbf7d3fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.582068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2501b20-5dbf-4c52-b58e-1babbf7d3fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.584029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2501b20-5dbf-4c52-b58e-1babbf7d3fa7 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.597619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab98bf-4585-431e-9295-27e7c3d03661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.598269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab98bf-4585-431e-9295-27e7c3d03661 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.598588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab98bf-4585-431e-9295-27e7c3d03661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.598860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab98bf-4585-431e-9295-27e7c3d03661 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.599589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab98bf-4585-431e-9295-27e7c3d03661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.601725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab98bf-4585-431e-9295-27e7c3d03661 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.610769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 784/1579] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.614034 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2501b20-5dbf-4c52-b58e-1babbf7d3fa7 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.634599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 796/1580] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.634599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc10b1-af26-4538-944e-d6faf932532a None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.634599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc10b1-af26-4538-944e-d6faf932532a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.634599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc10b1-af26-4538-944e-d6faf932532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.650492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-1afc10b1-af26-4538-944e-d6faf932532a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:24.651673 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1afc10b1-af26-4538-944e-d6faf932532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:24.672236 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2501b20-5dbf-4c52-b58e-1babbf7d3fa7 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.706194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 797/1581] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:24.707092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc10b1-af26-4538-944e-d6faf932532a None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.716685 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc10b1-af26-4538-944e-d6faf932532a None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.722337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f8f51-6509-4437-ae90-c34d78d0ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.723262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f8f51-6509-4437-ae90-c34d78d0ca0d admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.723541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f8f51-6509-4437-ae90-c34d78d0ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.723814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f8f51-6509-4437-ae90-c34d78d0ca0d admin admin] PATH_INFO: `/v3/projects/ea23d43080634ad7b66faf8014e88112/users/54860d5403d2429f8293530cf8aacd77/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.726935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19019b-7314-4fd0-8420-c20c2c2bf01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.727684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19019b-7314-4fd0-8420-c20c2c2bf01f admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.728026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19019b-7314-4fd0-8420-c20c2c2bf01f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.728358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19019b-7314-4fd0-8420-c20c2c2bf01f admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.729113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19019b-7314-4fd0-8420-c20c2c2bf01f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.731130 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19019b-7314-4fd0-8420-c20c2c2bf01f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.739205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f8f51-6509-4437-ae90-c34d78d0ca0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea23d43080634ad7b66faf8014e88112, user_id=54860d5403d2429f8293530cf8aacd77, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.741896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f8f51-6509-4437-ae90-c34d78d0ca0d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.751699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 785/1582] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.752564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19019b-7314-4fd0-8420-c20c2c2bf01f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.755403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 798/1583] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:24 2022] PUT /identity/v3/projects/ea23d43080634ad7b66faf8014e88112/users/54860d5403d2429f8293530cf8aacd77/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:24.756185 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f8f51-6509-4437-ae90-c34d78d0ca0d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.762005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19019b-7314-4fd0-8420-c20c2c2bf01f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.814438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce71580-0a11-49e3-822f-43507e9f4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.815021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71580-0a11-49e3-822f-43507e9f4b5e admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.815298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71580-0a11-49e3-822f-43507e9f4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.815563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71580-0a11-49e3-822f-43507e9f4b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.816246 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce71580-0a11-49e3-822f-43507e9f4b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.816949 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f8f51-6509-4437-ae90-c34d78d0ca0d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.818167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce71580-0a11-49e3-822f-43507e9f4b5e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.821564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0ea86-1fea-4b45-bda0-4970b7453109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.822381 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0ea86-1fea-4b45-bda0-4970b7453109 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.822661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0ea86-1fea-4b45-bda0-4970b7453109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.822932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0ea86-1fea-4b45-bda0-4970b7453109 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.823618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0ea86-1fea-4b45-bda0-4970b7453109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.825563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0ea86-1fea-4b45-bda0-4970b7453109 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.848085 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 786/1584] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.848085 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce71580-0a11-49e3-822f-43507e9f4b5e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.848389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 799/1585] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.848389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0ea86-1fea-4b45-bda0-4970b7453109 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.857898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0ea86-1fea-4b45-bda0-4970b7453109 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.907632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce71580-0a11-49e3-822f-43507e9f4b5e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.911867 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d992e2-8faa-49ca-9ef8-01b5be7b0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.912547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d992e2-8faa-49ca-9ef8-01b5be7b0609 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.912672 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09bb97-e4e7-4354-834d-aae88df6eca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.912829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d992e2-8faa-49ca-9ef8-01b5be7b0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.913104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d992e2-8faa-49ca-9ef8-01b5be7b0609 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.913307 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09bb97-e4e7-4354-834d-aae88df6eca0 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.913589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09bb97-e4e7-4354-834d-aae88df6eca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.913797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d992e2-8faa-49ca-9ef8-01b5be7b0609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.913889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09bb97-e4e7-4354-834d-aae88df6eca0 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.914571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09bb97-e4e7-4354-834d-aae88df6eca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.915782 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d992e2-8faa-49ca-9ef8-01b5be7b0609 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.916482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09bb97-e4e7-4354-834d-aae88df6eca0 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.936909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 800/1586] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.937531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d992e2-8faa-49ca-9ef8-01b5be7b0609 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.938304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 787/1587] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.939139 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09bb97-e4e7-4354-834d-aae88df6eca0 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.948938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d992e2-8faa-49ca-9ef8-01b5be7b0609 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.954406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303e30-4d41-4909-8e02-6ae0c08c780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.955099 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303e30-4d41-4909-8e02-6ae0c08c780b admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.955385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303e30-4d41-4909-8e02-6ae0c08c780b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.955657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303e30-4d41-4909-8e02-6ae0c08c780b admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.956340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a303e30-4d41-4909-8e02-6ae0c08c780b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.958304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a303e30-4d41-4909-8e02-6ae0c08c780b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.978705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 801/1588] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:24 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:24.979772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303e30-4d41-4909-8e02-6ae0c08c780b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:24.991255 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303e30-4d41-4909-8e02-6ae0c08c780b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.995136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09bb97-e4e7-4354-834d-aae88df6eca0 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:24.995845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b152e-6856-4718-8534-b4048398f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.996498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b152e-6856-4718-8534-b4048398f36a admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:24.996779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b152e-6856-4718-8534-b4048398f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:24.997050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b152e-6856-4718-8534-b4048398f36a admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:24.997776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b152e-6856-4718-8534-b4048398f36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:24.999204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6f191-c250-49b9-bf84-c240fb7ceeb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:24.999596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b152e-6856-4718-8534-b4048398f36a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:24.999858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6f191-c250-49b9-bf84-c240fb7ceeb1 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.000142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6f191-c250-49b9-bf84-c240fb7ceeb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.000419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6f191-c250-49b9-bf84-c240fb7ceeb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.009618 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6f191-c250-49b9-bf84-c240fb7ceeb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.009827 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 802/1589] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.011061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b78109-c6aa-455b-90b1-8d84b9dbc7ef None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.011178 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6f191-c250-49b9-bf84-c240fb7ceeb1 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.011354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b78109-c6aa-455b-90b1-8d84b9dbc7ef None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.011611 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b78109-c6aa-455b-90b1-8d84b9dbc7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.021027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 788/1590] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:25.021963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6f191-c250-49b9-bf84-c240fb7ceeb1 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.027940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-11b78109-c6aa-455b-90b1-8d84b9dbc7ef None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:25.029253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-11b78109-c6aa-455b-90b1-8d84b9dbc7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:25.030986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6f191-c250-49b9-bf84-c240fb7ceeb1 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.036328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83f63f-4c50-496a-9f7f-def7691e242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.037162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83f63f-4c50-496a-9f7f-def7691e242e admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.037620 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83f63f-4c50-496a-9f7f-def7691e242e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.037763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 803/1591] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:25.040936 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b78109-c6aa-455b-90b1-8d84b9dbc7ef None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.041855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83f63f-4c50-496a-9f7f-def7691e242e admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.042747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83f63f-4c50-496a-9f7f-def7691e242e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.044837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83f63f-4c50-496a-9f7f-def7691e242e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.048808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b78109-c6aa-455b-90b1-8d84b9dbc7ef None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.054052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed11d1-5d6f-4786-ad4c-bcbca32b365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.054724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed11d1-5d6f-4786-ad4c-bcbca32b365a admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.054947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed11d1-5d6f-4786-ad4c-bcbca32b365a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.055202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed11d1-5d6f-4786-ad4c-bcbca32b365a admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.056037 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed11d1-5d6f-4786-ad4c-bcbca32b365a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.057811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed11d1-5d6f-4786-ad4c-bcbca32b365a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.067658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 789/1592] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:25 2022] POST /identity/v3/users => generated 284 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:25.068443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83f63f-4c50-496a-9f7f-def7691e242e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.071826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 804/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.072711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed11d1-5d6f-4786-ad4c-bcbca32b365a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.079893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83f63f-4c50-496a-9f7f-def7691e242e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.082449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed11d1-5d6f-4786-ad4c-bcbca32b365a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.084567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b17444-3cde-4cb1-b75b-36d9b7db3c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.085209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b17444-3cde-4cb1-b75b-36d9b7db3c54 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.085532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b17444-3cde-4cb1-b75b-36d9b7db3c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.085910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b17444-3cde-4cb1-b75b-36d9b7db3c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.086831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b17444-3cde-4cb1-b75b-36d9b7db3c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.087785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcec497-240c-4a49-abcc-112013a36bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.088485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b17444-3cde-4cb1-b75b-36d9b7db3c54 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.088619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcec497-240c-4a49-abcc-112013a36bdd admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.088815 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcec497-240c-4a49-abcc-112013a36bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.089063 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcec497-240c-4a49-abcc-112013a36bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.089844 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcec497-240c-4a49-abcc-112013a36bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.091514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcec497-240c-4a49-abcc-112013a36bdd admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.099521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 790/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.100472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b17444-3cde-4cb1-b75b-36d9b7db3c54 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.103598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 805/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.104548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcec497-240c-4a49-abcc-112013a36bdd admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.110995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b17444-3cde-4cb1-b75b-36d9b7db3c54 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.114631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcec497-240c-4a49-abcc-112013a36bdd admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.117316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59d2b9-a424-4a1e-8227-b6f46fc8cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.117999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59d2b9-a424-4a1e-8227-b6f46fc8cca3 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.118574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59d2b9-a424-4a1e-8227-b6f46fc8cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.118923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59d2b9-a424-4a1e-8227-b6f46fc8cca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.119854 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59d2b9-a424-4a1e-8227-b6f46fc8cca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.120038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabfbb5-9926-4636-8c12-d4d581989cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.120633 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabfbb5-9926-4636-8c12-d4d581989cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.120885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabfbb5-9926-4636-8c12-d4d581989cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.121156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabfbb5-9926-4636-8c12-d4d581989cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.121602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59d2b9-a424-4a1e-8227-b6f46fc8cca3 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.121875 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabfbb5-9926-4636-8c12-d4d581989cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.123500 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabfbb5-9926-4636-8c12-d4d581989cf6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.133778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 806/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.134549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabfbb5-9926-4636-8c12-d4d581989cf6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.139883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 791/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.140245 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59d2b9-a424-4a1e-8227-b6f46fc8cca3 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.148504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabfbb5-9926-4636-8c12-d4d581989cf6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.151421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59d2b9-a424-4a1e-8227-b6f46fc8cca3 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.153040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a909-4ab7-4a45-ace9-d7ae104b55f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.154257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a909-4ab7-4a45-ace9-d7ae104b55f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.154721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a909-4ab7-4a45-ace9-d7ae104b55f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.155087 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a909-4ab7-4a45-ace9-d7ae104b55f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.156574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdfef9-ab8b-41b6-a4d2-19f7f69733ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.157252 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdfef9-ab8b-41b6-a4d2-19f7f69733ce admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.157523 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdfef9-ab8b-41b6-a4d2-19f7f69733ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.157796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdfef9-ab8b-41b6-a4d2-19f7f69733ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.158808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdfef9-ab8b-41b6-a4d2-19f7f69733ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.160281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdfef9-ab8b-41b6-a4d2-19f7f69733ce admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.167379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0a909-4ab7-4a45-ace9-d7ae104b55f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.168564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0a909-4ab7-4a45-ace9-d7ae104b55f7 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.174164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 792/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.174164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdfef9-ab8b-41b6-a4d2-19f7f69733ce admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.181166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 807/1599] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:25.182117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a909-4ab7-4a45-ace9-d7ae104b55f7 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.184359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdfef9-ab8b-41b6-a4d2-19f7f69733ce admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.189685 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378ebc7-9fcc-4ab6-9327-cf3102525817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.190644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378ebc7-9fcc-4ab6-9327-cf3102525817 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.191004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378ebc7-9fcc-4ab6-9327-cf3102525817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.191443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378ebc7-9fcc-4ab6-9327-cf3102525817 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.191968 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a909-4ab7-4a45-ace9-d7ae104b55f7 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.192389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378ebc7-9fcc-4ab6-9327-cf3102525817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.194505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378ebc7-9fcc-4ab6-9327-cf3102525817 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.199297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb1448-3561-460f-a355-52bccf1423ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.200253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb1448-3561-460f-a355-52bccf1423ad admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.200621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb1448-3561-460f-a355-52bccf1423ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.203787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb1448-3561-460f-a355-52bccf1423ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.203787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb1448-3561-460f-a355-52bccf1423ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.205288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb1448-3561-460f-a355-52bccf1423ad admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.208587 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 793/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.213001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378ebc7-9fcc-4ab6-9327-cf3102525817 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.221590 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 808/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.222567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb1448-3561-460f-a355-52bccf1423ad admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.228985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378ebc7-9fcc-4ab6-9327-cf3102525817 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.235177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95408bb8-41c1-4796-a578-8dde7ac7cfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.235972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95408bb8-41c1-4796-a578-8dde7ac7cfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.236129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb1448-3561-460f-a355-52bccf1423ad admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.236424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95408bb8-41c1-4796-a578-8dde7ac7cfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.236863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95408bb8-41c1-4796-a578-8dde7ac7cfa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.237930 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95408bb8-41c1-4796-a578-8dde7ac7cfa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.240564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95408bb8-41c1-4796-a578-8dde7ac7cfa5 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.243177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50306d-c856-4ca8-9997-5a8c427a1b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.244167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50306d-c856-4ca8-9997-5a8c427a1b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.244444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50306d-c856-4ca8-9997-5a8c427a1b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.244748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50306d-c856-4ca8-9997-5a8c427a1b15 admin admin] PATH_INFO: `/v3/projects/ba374b2de5324250b7cd9383ea5d1a1e/users/6c853d04dd5147f5961bf551b608da33/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.254917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 794/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.259138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95408bb8-41c1-4796-a578-8dde7ac7cfa5 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.266241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50306d-c856-4ca8-9997-5a8c427a1b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba374b2de5324250b7cd9383ea5d1a1e, user_id=6c853d04dd5147f5961bf551b608da33, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.269209 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50306d-c856-4ca8-9997-5a8c427a1b15 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.274855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95408bb8-41c1-4796-a578-8dde7ac7cfa5 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.282386 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6f33-f64c-440a-9356-00e3c2367280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.283930 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6f33-f64c-440a-9356-00e3c2367280 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.285273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6f33-f64c-440a-9356-00e3c2367280 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.286119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6f33-f64c-440a-9356-00e3c2367280 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.286873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 809/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:25 2022] PUT /identity/v3/projects/ba374b2de5324250b7cd9383ea5d1a1e/users/6c853d04dd5147f5961bf551b608da33/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:25.287234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d6f33-f64c-440a-9356-00e3c2367280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.288164 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50306d-c856-4ca8-9997-5a8c427a1b15 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.290551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d6f33-f64c-440a-9356-00e3c2367280 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.306249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 795/1604] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.307514 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6f33-f64c-440a-9356-00e3c2367280 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.322601 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6f33-f64c-440a-9356-00e3c2367280 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.362034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50306d-c856-4ca8-9997-5a8c427a1b15 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.367134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97d269-95f0-4660-981e-2d012739219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.368426 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97d269-95f0-4660-981e-2d012739219b admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.368783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97d269-95f0-4660-981e-2d012739219b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.369124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97d269-95f0-4660-981e-2d012739219b admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.370552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97d269-95f0-4660-981e-2d012739219b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.372337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97d269-95f0-4660-981e-2d012739219b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.386524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 810/1605] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:25.387578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97d269-95f0-4660-981e-2d012739219b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.400321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97d269-95f0-4660-981e-2d012739219b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.400481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e12486-d741-4d72-b0aa-91dcf1d77142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.401487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e12486-d741-4d72-b0aa-91dcf1d77142 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.401822 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e12486-d741-4d72-b0aa-91dcf1d77142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.402329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e12486-d741-4d72-b0aa-91dcf1d77142 admin admin] PATH_INFO: `/v3/projects/efdb1671bef84ba3a45bc253adb78693/users/fcef95d389e34ac9a6ae68c7256cc0ce/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.409360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617b67a-d311-49a0-92cb-6fa4eb3ceef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.410614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617b67a-d311-49a0-92cb-6fa4eb3ceef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.411547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617b67a-d311-49a0-92cb-6fa4eb3ceef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.412031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617b67a-d311-49a0-92cb-6fa4eb3ceef8 admin admin] PATH_INFO: `/v3/projects/5cf1e55335df4fff9fa32196310d6fd2/users/d0156620c4bd42d781871ebfdd490150/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.425808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e12486-d741-4d72-b0aa-91dcf1d77142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efdb1671bef84ba3a45bc253adb78693, user_id=fcef95d389e34ac9a6ae68c7256cc0ce, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.426895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING py.warnings [None req-f4e12486-d741-4d72-b0aa-91dcf1d77142 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:52:25.426895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: warnings.warn(msg) Oct 28 19:52:25.426895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: Oct 28 19:52:25.428916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e12486-d741-4d72-b0aa-91dcf1d77142 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.438994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617b67a-d311-49a0-92cb-6fa4eb3ceef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf1e55335df4fff9fa32196310d6fd2, user_id=d0156620c4bd42d781871ebfdd490150, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.444000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617b67a-d311-49a0-92cb-6fa4eb3ceef8 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.450163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 796/1606] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:25 2022] PUT /identity/v3/projects/efdb1671bef84ba3a45bc253adb78693/users/fcef95d389e34ac9a6ae68c7256cc0ce/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:25.451212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e12486-d741-4d72-b0aa-91dcf1d77142 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.476472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 811/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:25 2022] PUT /identity/v3/projects/5cf1e55335df4fff9fa32196310d6fd2/users/d0156620c4bd42d781871ebfdd490150/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:25.481447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281170f8-bdea-4317-8458-8e956c536d60 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.484123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281170f8-bdea-4317-8458-8e956c536d60 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.484557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281170f8-bdea-4317-8458-8e956c536d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.511650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-281170f8-bdea-4317-8458-8e956c536d60 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:25.512884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-281170f8-bdea-4317-8458-8e956c536d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:25.553458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e12486-d741-4d72-b0aa-91dcf1d77142 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.595280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 812/1608] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:25.596431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281170f8-bdea-4317-8458-8e956c536d60 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.610954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281170f8-bdea-4317-8458-8e956c536d60 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.617196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27479-defd-4cd1-8b9b-00c9f698b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.618388 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27479-defd-4cd1-8b9b-00c9f698b3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.618871 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27479-defd-4cd1-8b9b-00c9f698b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.619429 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27479-defd-4cd1-8b9b-00c9f698b3c7 admin admin] PATH_INFO: `/v3/projects/79689d6f11a742d7b30e8d2081334602/users/2585c34309964e04b69e75f7d91baf25/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.619760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cb96b-04cc-430e-afe0-c4791ce6ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.620666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb96b-04cc-430e-afe0-c4791ce6ebbe admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.620947 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb96b-04cc-430e-afe0-c4791ce6ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.621258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb96b-04cc-430e-afe0-c4791ce6ebbe admin admin] PATH_INFO: `/v3/projects/921d37b3427046159478a9f855327015/users/f212486a7e4c4945b5c97027a97e769e/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.637429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cb96b-04cc-430e-afe0-c4791ce6ebbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=921d37b3427046159478a9f855327015, user_id=f212486a7e4c4945b5c97027a97e769e, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.640370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cb96b-04cc-430e-afe0-c4791ce6ebbe admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.643966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a27479-defd-4cd1-8b9b-00c9f698b3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79689d6f11a742d7b30e8d2081334602, user_id=2585c34309964e04b69e75f7d91baf25, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.647742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a27479-defd-4cd1-8b9b-00c9f698b3c7 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.659100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 797/1609] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:25 2022] PUT /identity/v3/projects/921d37b3427046159478a9f855327015/users/f212486a7e4c4945b5c97027a97e769e/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:25.660380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cb96b-04cc-430e-afe0-c4791ce6ebbe admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.666725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 813/1610] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:25 2022] PUT /identity/v3/projects/79689d6f11a742d7b30e8d2081334602/users/2585c34309964e04b69e75f7d91baf25/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:25.668635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf5f29-07d8-4b15-a0b2-72a2f8148ce9 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.668635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf5f29-07d8-4b15-a0b2-72a2f8148ce9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.668938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf5f29-07d8-4b15-a0b2-72a2f8148ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.704539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-35bf5f29-07d8-4b15-a0b2-72a2f8148ce9 None None] MFA Rules not processed for user `fcef95d389e34ac9a6ae68c7256cc0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:25.707287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-35bf5f29-07d8-4b15-a0b2-72a2f8148ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:25.773109 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cb96b-04cc-430e-afe0-c4791ce6ebbe admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:25.795247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 814/1611] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:25.796897 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2cb13-b220-4476-abe7-cc444e38e8c1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.797265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2cb13-b220-4476-abe7-cc444e38e8c1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.797607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2cb13-b220-4476-abe7-cc444e38e8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.854977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-60b2cb13-b220-4476-abe7-cc444e38e8c1 None None] MFA Rules not processed for user `d0156620c4bd42d781871ebfdd490150`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:25.856209 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-60b2cb13-b220-4476-abe7-cc444e38e8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:25.859832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb4ff7-f2f0-4615-bb9e-99a5669745fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:25.860732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb4ff7-f2f0-4615-bb9e-99a5669745fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.861018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb4ff7-f2f0-4615-bb9e-99a5669745fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.861491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb4ff7-f2f0-4615-bb9e-99a5669745fe admin admin] PATH_INFO: `/v3/projects/c85b5b32e6ed4796a218c14ab2359d44/users/2b3621c2bde14f16a473675c0f63640c/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.882922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb4ff7-f2f0-4615-bb9e-99a5669745fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85b5b32e6ed4796a218c14ab2359d44, user_id=2b3621c2bde14f16a473675c0f63640c, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:25.888456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb4ff7-f2f0-4615-bb9e-99a5669745fe admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:25.914838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 798/1612] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:25 2022] PUT /identity/v3/projects/c85b5b32e6ed4796a218c14ab2359d44/users/2b3621c2bde14f16a473675c0f63640c/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:25.914838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb4ff7-f2f0-4615-bb9e-99a5669745fe admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:25.964301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 815/1613] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:25.965947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624cf14-e3b6-4b98-9c74-43ac16e779d5 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:25.966396 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624cf14-e3b6-4b98-9c74-43ac16e779d5 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:25.966831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624cf14-e3b6-4b98-9c74-43ac16e779d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:25.999238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0624cf14-e3b6-4b98-9c74-43ac16e779d5 None None] MFA Rules not processed for user `f212486a7e4c4945b5c97027a97e769e`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:26.000222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb4ff7-f2f0-4615-bb9e-99a5669745fe admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.001247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0624cf14-e3b6-4b98-9c74-43ac16e779d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:26.005887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dca5f-7197-49aa-b2b2-7ab58be36f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:26.006954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dca5f-7197-49aa-b2b2-7ab58be36f9e service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.007356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dca5f-7197-49aa-b2b2-7ab58be36f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.008877 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dca5f-7197-49aa-b2b2-7ab58be36f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.111414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dca5f-7197-49aa-b2b2-7ab58be36f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:26.112992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dca5f-7197-49aa-b2b2-7ab58be36f9e service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:26.119757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 816/1614] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:26.121401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f139e0-caf1-4d86-b794-0118a348969c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.122172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f139e0-caf1-4d86-b794-0118a348969c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.122621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f139e0-caf1-4d86-b794-0118a348969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.136103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 799/1615] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:26.137124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dca5f-7197-49aa-b2b2-7ab58be36f9e service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.165143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-e6f139e0-caf1-4d86-b794-0118a348969c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:26.166625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e6f139e0-caf1-4d86-b794-0118a348969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:26.173269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dca5f-7197-49aa-b2b2-7ab58be36f9e service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.180613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 817/1616] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:26.182153 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54055fc7-abbd-49f1-b8eb-fe3d76685e93 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.182549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54055fc7-abbd-49f1-b8eb-fe3d76685e93 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.182830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54055fc7-abbd-49f1-b8eb-fe3d76685e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.186857 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5ab4a-6f92-46cf-92e9-67bff60e7458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:26.187765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ab4a-6f92-46cf-92e9-67bff60e7458 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.190391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ab4a-6f92-46cf-92e9-67bff60e7458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.190900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ab4a-6f92-46cf-92e9-67bff60e7458 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.191756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5ab4a-6f92-46cf-92e9-67bff60e7458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:26.196592 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5ab4a-6f92-46cf-92e9-67bff60e7458 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:26.220597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-54055fc7-abbd-49f1-b8eb-fe3d76685e93 None None] MFA Rules not processed for user `2b3621c2bde14f16a473675c0f63640c`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:26.221819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-54055fc7-abbd-49f1-b8eb-fe3d76685e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:26.250766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 800/1617] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:26.252044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5ab4a-6f92-46cf-92e9-67bff60e7458 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.323983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 818/1618] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:26.325735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec42941-d5d2-4fd0-b34d-e3ef1f41aa90 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.326256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec42941-d5d2-4fd0-b34d-e3ef1f41aa90 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.326552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec42941-d5d2-4fd0-b34d-e3ef1f41aa90 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.328664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 819/1619] 10.222.0.20 () {54 vars in 959 bytes} [Fri Oct 28 19:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:26.330020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efef703-55cd-4b15-a91c-e265c3c5d0f1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.330337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efef703-55cd-4b15-a91c-e265c3c5d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.330621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efef703-55cd-4b15-a91c-e265c3c5d0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.369462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2efef703-55cd-4b15-a91c-e265c3c5d0f1 None None] MFA Rules not processed for user `54860d5403d2429f8293530cf8aacd77`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:26.371514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2efef703-55cd-4b15-a91c-e265c3c5d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:26.380821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5ab4a-6f92-46cf-92e9-67bff60e7458 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.398599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578ca2-285a-4237-b44c-92876d1d374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:26.399282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578ca2-285a-4237-b44c-92876d1d374b admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.399560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578ca2-285a-4237-b44c-92876d1d374b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.399830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578ca2-285a-4237-b44c-92876d1d374b admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.400530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578ca2-285a-4237-b44c-92876d1d374b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:26.402517 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578ca2-285a-4237-b44c-92876d1d374b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:26.451771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 801/1620] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:26.452650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578ca2-285a-4237-b44c-92876d1d374b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.466707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 820/1621] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:26.467567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efef703-55cd-4b15-a91c-e265c3c5d0f1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.479638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efef703-55cd-4b15-a91c-e265c3c5d0f1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.559448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578ca2-285a-4237-b44c-92876d1d374b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.564987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217453b1-a4c1-4fe1-b5d9-b2be7e872392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:26.566213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217453b1-a4c1-4fe1-b5d9-b2be7e872392 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.566653 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217453b1-a4c1-4fe1-b5d9-b2be7e872392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.567054 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217453b1-a4c1-4fe1-b5d9-b2be7e872392 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.567979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217453b1-a4c1-4fe1-b5d9-b2be7e872392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:26.572000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217453b1-a4c1-4fe1-b5d9-b2be7e872392 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:26.573237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cc75f-749a-427d-9033-0ca66e2432fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:26.574050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc75f-749a-427d-9033-0ca66e2432fa service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.574205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc75f-749a-427d-9033-0ca66e2432fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.574460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc75f-749a-427d-9033-0ca66e2432fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.588661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cc75f-749a-427d-9033-0ca66e2432fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:26.590160 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cc75f-749a-427d-9033-0ca66e2432fa service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:26.610939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 802/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:26.611673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cc75f-749a-427d-9033-0ca66e2432fa service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.620899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 821/1623] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:26.621712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cc75f-749a-427d-9033-0ca66e2432fa service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.622236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef53a-d0dd-4052-9214-8c6d697ac89a None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.622568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef53a-d0dd-4052-9214-8c6d697ac89a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.622868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef53a-d0dd-4052-9214-8c6d697ac89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.628468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f489b-160f-4546-8fd0-97e26944b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:26.629374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f489b-160f-4546-8fd0-97e26944b71a admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.629836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f489b-160f-4546-8fd0-97e26944b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.630321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f489b-160f-4546-8fd0-97e26944b71a admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.631274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f489b-160f-4546-8fd0-97e26944b71a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:26.633465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f489b-160f-4546-8fd0-97e26944b71a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:26.659558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2b6ef53a-d0dd-4052-9214-8c6d697ac89a None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:26.661473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2b6ef53a-d0dd-4052-9214-8c6d697ac89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:26.671337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 803/1624] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:26.672497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f489b-160f-4546-8fd0-97e26944b71a admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.750587 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f489b-160f-4546-8fd0-97e26944b71a admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.756000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c349eed-9fd6-470d-af07-6c74a8295460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:26.756543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349eed-9fd6-470d-af07-6c74a8295460 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.756847 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349eed-9fd6-470d-af07-6c74a8295460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.757117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349eed-9fd6-470d-af07-6c74a8295460 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.757960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c349eed-9fd6-470d-af07-6c74a8295460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:26.761300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c349eed-9fd6-470d-af07-6c74a8295460 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:26.762935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 822/1625] 10.222.0.20 () {58 vars in 1056 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:26.764106 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ef53a-d0dd-4052-9214-8c6d697ac89a None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.777159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ef53a-d0dd-4052-9214-8c6d697ac89a None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.784443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26addb03-bbde-44d2-8276-2415724eaa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:26.785412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26addb03-bbde-44d2-8276-2415724eaa30 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.786321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26addb03-bbde-44d2-8276-2415724eaa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.786919 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26addb03-bbde-44d2-8276-2415724eaa30 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.788483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26addb03-bbde-44d2-8276-2415724eaa30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:26.791678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26addb03-bbde-44d2-8276-2415724eaa30 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:26.792145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 804/1626] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:26.793090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c349eed-9fd6-470d-af07-6c74a8295460 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.817924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c349eed-9fd6-470d-af07-6c74a8295460 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.825115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c00a-cd0a-4d66-81e1-5826300bf7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:26.825891 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c00a-cd0a-4d66-81e1-5826300bf7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.826250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c00a-cd0a-4d66-81e1-5826300bf7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.826537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c00a-cd0a-4d66-81e1-5826300bf7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.827362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85c00a-cd0a-4d66-81e1-5826300bf7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:26.830570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 823/1627] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/projects => generated 403 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:26.832858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85c00a-cd0a-4d66-81e1-5826300bf7a5 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:26.833804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26addb03-bbde-44d2-8276-2415724eaa30 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.859766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 805/1628] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:26.860728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c00a-cd0a-4d66-81e1-5826300bf7a5 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.936966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26addb03-bbde-44d2-8276-2415724eaa30 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.946351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b9cf7-95f4-4bf6-8f5b-f72640ac7d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:26.947110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b9cf7-95f4-4bf6-8f5b-f72640ac7d44 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.947787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b9cf7-95f4-4bf6-8f5b-f72640ac7d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.947915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b9cf7-95f4-4bf6-8f5b-f72640ac7d44 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.948707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b9cf7-95f4-4bf6-8f5b-f72640ac7d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:26.951240 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b9cf7-95f4-4bf6-8f5b-f72640ac7d44 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:26.989549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c00a-cd0a-4d66-81e1-5826300bf7a5 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:26.991711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 824/1629] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:26.992412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b9cf7-95f4-4bf6-8f5b-f72640ac7d44 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.006175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b9cf7-95f4-4bf6-8f5b-f72640ac7d44 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.011862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362ec3e-197d-4874-b3a2-52a8bd058dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.012549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362ec3e-197d-4874-b3a2-52a8bd058dac admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.012831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362ec3e-197d-4874-b3a2-52a8bd058dac admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.013102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362ec3e-197d-4874-b3a2-52a8bd058dac admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.013825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362ec3e-197d-4874-b3a2-52a8bd058dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.016435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362ec3e-197d-4874-b3a2-52a8bd058dac admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.039275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 825/1630] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:27.039275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362ec3e-197d-4874-b3a2-52a8bd058dac admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.051236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362ec3e-197d-4874-b3a2-52a8bd058dac admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.057707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5f7ae-1e68-47ad-a870-b5a1347f5deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.058571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5f7ae-1e68-47ad-a870-b5a1347f5deb admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.059091 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5f7ae-1e68-47ad-a870-b5a1347f5deb admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.059687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5f7ae-1e68-47ad-a870-b5a1347f5deb admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.060427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5f7ae-1e68-47ad-a870-b5a1347f5deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.062880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5f7ae-1e68-47ad-a870-b5a1347f5deb admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.089079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 826/1631] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:27 2022] POST /identity/v3/users => generated 308 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:27.090251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5f7ae-1e68-47ad-a870-b5a1347f5deb admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.094576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8d2f1-d09c-4b4f-a7c1-7633f3d9a469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.095728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8d2f1-d09c-4b4f-a7c1-7633f3d9a469 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.096175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8d2f1-d09c-4b4f-a7c1-7633f3d9a469 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.096605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8d2f1-d09c-4b4f-a7c1-7633f3d9a469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.104866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5f7ae-1e68-47ad-a870-b5a1347f5deb admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.111691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54d93e-3a4c-4e8f-a321-2fa0fb33dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.112835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54d93e-3a4c-4e8f-a321-2fa0fb33dfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.113328 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54d93e-3a4c-4e8f-a321-2fa0fb33dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.114018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54d93e-3a4c-4e8f-a321-2fa0fb33dfb9 admin admin] PATH_INFO: `/v3/projects/07ac76422f2842a298cef8d18e037928/users/ee720dc4ed424e6dbc0543aa47611a78/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.136440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54d93e-3a4c-4e8f-a321-2fa0fb33dfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ac76422f2842a298cef8d18e037928, user_id=ee720dc4ed424e6dbc0543aa47611a78, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.153727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54d93e-3a4c-4e8f-a321-2fa0fb33dfb9 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.177275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8d2f1-d09c-4b4f-a7c1-7633f3d9a469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.179575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8d2f1-d09c-4b4f-a7c1-7633f3d9a469 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.184840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 827/1632] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:27 2022] PUT /identity/v3/projects/07ac76422f2842a298cef8d18e037928/users/ee720dc4ed424e6dbc0543aa47611a78/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:27.190329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54d93e-3a4c-4e8f-a321-2fa0fb33dfb9 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.193294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 806/1633] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:27.194581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8d2f1-d09c-4b4f-a7c1-7633f3d9a469 service nova] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.205731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8d2f1-d09c-4b4f-a7c1-7633f3d9a469 service nova] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.265504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08a5a-0313-4d3e-b8bf-8b5ae8d65c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.266435 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08a5a-0313-4d3e-b8bf-8b5ae8d65c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.267156 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08a5a-0313-4d3e-b8bf-8b5ae8d65c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.267156 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08a5a-0313-4d3e-b8bf-8b5ae8d65c08 admin admin] PATH_INFO: `/v3/projects/17724c8e60a74cfba610818de80e8291/users/9c836181c45e46739bef7f6ae91ba1f6/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.278767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54d93e-3a4c-4e8f-a321-2fa0fb33dfb9 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.285364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08a5a-0313-4d3e-b8bf-8b5ae8d65c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17724c8e60a74cfba610818de80e8291, user_id=9c836181c45e46739bef7f6ae91ba1f6, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.286751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880b220-af9a-4196-9b6d-443333a8c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.288134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880b220-af9a-4196-9b6d-443333a8c544 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.288623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880b220-af9a-4196-9b6d-443333a8c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.289181 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08a5a-0313-4d3e-b8bf-8b5ae8d65c08 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.295780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880b220-af9a-4196-9b6d-443333a8c544 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.296855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880b220-af9a-4196-9b6d-443333a8c544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.299742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880b220-af9a-4196-9b6d-443333a8c544 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.308599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 807/1634] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:27 2022] PUT /identity/v3/projects/17724c8e60a74cfba610818de80e8291/users/9c836181c45e46739bef7f6ae91ba1f6/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:27.309833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08a5a-0313-4d3e-b8bf-8b5ae8d65c08 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.313100 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 828/1635] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:27.314193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880b220-af9a-4196-9b6d-443333a8c544 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.324732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880b220-af9a-4196-9b6d-443333a8c544 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.382772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08a5a-0313-4d3e-b8bf-8b5ae8d65c08 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.387653 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059f8ba-1f97-42b4-8fda-5618751b93e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.388410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059f8ba-1f97-42b4-8fda-5618751b93e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.388660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfab64-0aaa-4b42-b966-ccf0f8651828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.388820 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059f8ba-1f97-42b4-8fda-5618751b93e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.389360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059f8ba-1f97-42b4-8fda-5618751b93e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.389529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfab64-0aaa-4b42-b966-ccf0f8651828 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.389937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfab64-0aaa-4b42-b966-ccf0f8651828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.390301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfab64-0aaa-4b42-b966-ccf0f8651828 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.390726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059f8ba-1f97-42b4-8fda-5618751b93e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.391174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfab64-0aaa-4b42-b966-ccf0f8651828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.392882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059f8ba-1f97-42b4-8fda-5618751b93e6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.393167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfab64-0aaa-4b42-b966-ccf0f8651828 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.404731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 829/1636] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:27.405797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059f8ba-1f97-42b4-8fda-5618751b93e6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.414633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 808/1637] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:27.414633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfab64-0aaa-4b42-b966-ccf0f8651828 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.419226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059f8ba-1f97-42b4-8fda-5618751b93e6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.429125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66da852-55f0-4318-b7a1-27fb045c8d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.432391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66da852-55f0-4318-b7a1-27fb045c8d3c admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.433059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66da852-55f0-4318-b7a1-27fb045c8d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.433418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66da852-55f0-4318-b7a1-27fb045c8d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.434492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66da852-55f0-4318-b7a1-27fb045c8d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.435537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfab64-0aaa-4b42-b966-ccf0f8651828 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.441385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb776723-68db-4559-8f84-8dbd05a71502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.442725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66da852-55f0-4318-b7a1-27fb045c8d3c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.443921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb776723-68db-4559-8f84-8dbd05a71502 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.443921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb776723-68db-4559-8f84-8dbd05a71502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.443921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb776723-68db-4559-8f84-8dbd05a71502 admin admin] PATH_INFO: `/v3/projects/7dfe737514c34667bcd39ef78376890a/users/5f372abca9bf40eb88d93b0115606e32/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.461568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb776723-68db-4559-8f84-8dbd05a71502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfe737514c34667bcd39ef78376890a, user_id=5f372abca9bf40eb88d93b0115606e32, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.464899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb776723-68db-4559-8f84-8dbd05a71502 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.473017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 830/1638] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:27.475631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66da852-55f0-4318-b7a1-27fb045c8d3c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.490300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 809/1639] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:27 2022] PUT /identity/v3/projects/7dfe737514c34667bcd39ef78376890a/users/5f372abca9bf40eb88d93b0115606e32/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:27.492349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb776723-68db-4559-8f84-8dbd05a71502 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.502055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66da852-55f0-4318-b7a1-27fb045c8d3c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.619509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7730a-8fe0-4844-bdfb-80ee02a8a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.620722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7730a-8fe0-4844-bdfb-80ee02a8a141 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.621010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7730a-8fe0-4844-bdfb-80ee02a8a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.621576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7730a-8fe0-4844-bdfb-80ee02a8a141 admin admin] PATH_INFO: `/v3/projects/07ac76422f2842a298cef8d18e037928/users/ee720dc4ed424e6dbc0543aa47611a78/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.623431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7730a-8fe0-4844-bdfb-80ee02a8a141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ac76422f2842a298cef8d18e037928, user_id=ee720dc4ed424e6dbc0543aa47611a78, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.626514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7730a-8fe0-4844-bdfb-80ee02a8a141 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.634297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb776723-68db-4559-8f84-8dbd05a71502 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.657011 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 831/1640] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:27 2022] PUT /identity/v3/projects/07ac76422f2842a298cef8d18e037928/users/ee720dc4ed424e6dbc0543aa47611a78/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:27.658942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7730a-8fe0-4844-bdfb-80ee02a8a141 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.746249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bbdf8-5306-48d7-b595-242695580308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.747347 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bbdf8-5306-48d7-b595-242695580308 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.747706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bbdf8-5306-48d7-b595-242695580308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.748170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bbdf8-5306-48d7-b595-242695580308 admin admin] PATH_INFO: `/v3/projects/895f558c24584c6aa8b89586c928b0fd/users/bd0f951702e64a329a37c1f54b96fb87/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.779490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bbdf8-5306-48d7-b595-242695580308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895f558c24584c6aa8b89586c928b0fd, user_id=bd0f951702e64a329a37c1f54b96fb87, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.783724 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bbdf8-5306-48d7-b595-242695580308 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.804854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7730a-8fe0-4844-bdfb-80ee02a8a141 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.819977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 810/1641] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:27 2022] PUT /identity/v3/projects/895f558c24584c6aa8b89586c928b0fd/users/bd0f951702e64a329a37c1f54b96fb87/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:27.821947 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bbdf8-5306-48d7-b595-242695580308 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:27.896788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bbdf8-5306-48d7-b595-242695580308 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.902427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d31f90-4358-4f60-9b19-7ec6835f71dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.903110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31f90-4358-4f60-9b19-7ec6835f71dd admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.903388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31f90-4358-4f60-9b19-7ec6835f71dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.903659 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31f90-4358-4f60-9b19-7ec6835f71dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.904621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d31f90-4358-4f60-9b19-7ec6835f71dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.915339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d31f90-4358-4f60-9b19-7ec6835f71dd admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.929191 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 811/1642] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:27.931754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467716-97e6-49f6-84fb-c02a75bff2dd None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.931754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467716-97e6-49f6-84fb-c02a75bff2dd None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.931965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467716-97e6-49f6-84fb-c02a75bff2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.943149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c081ab-bff7-48d9-bee6-eacf8c58c446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.944435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c081ab-bff7-48d9-bee6-eacf8c58c446 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.944898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c081ab-bff7-48d9-bee6-eacf8c58c446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.945325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c081ab-bff7-48d9-bee6-eacf8c58c446 admin admin] PATH_INFO: `/v3/projects/17724c8e60a74cfba610818de80e8291/users/9c836181c45e46739bef7f6ae91ba1f6/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.947738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c081ab-bff7-48d9-bee6-eacf8c58c446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17724c8e60a74cfba610818de80e8291, user_id=9c836181c45e46739bef7f6ae91ba1f6, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.951242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c081ab-bff7-48d9-bee6-eacf8c58c446 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.975242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-91467716-97e6-49f6-84fb-c02a75bff2dd None None] MFA Rules not processed for user `ee720dc4ed424e6dbc0543aa47611a78`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:27.977503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-91467716-97e6-49f6-84fb-c02a75bff2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:28.000490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 832/1643] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:27 2022] PUT /identity/v3/projects/17724c8e60a74cfba610818de80e8291/users/9c836181c45e46739bef7f6ae91ba1f6/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:28.001828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c081ab-bff7-48d9-bee6-eacf8c58c446 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:28.122533 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 812/1644] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:28.136697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2b7f0-71b0-435e-a888-87cabe3b57a0 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.137563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2b7f0-71b0-435e-a888-87cabe3b57a0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.139502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2b7f0-71b0-435e-a888-87cabe3b57a0 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.142051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 813/1645] 10.222.0.20 () {54 vars in 959 bytes} [Fri Oct 28 19:52:28 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:28.145407 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2b7f0-71b0-435e-a888-87cabe3b57a0 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:28.145564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c081ab-bff7-48d9-bee6-eacf8c58c446 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:28.151090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ee965-dede-416f-87cb-63007454f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:28.151808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee965-dede-416f-87cb-63007454f903 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.152042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee965-dede-416f-87cb-63007454f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.152425 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee965-dede-416f-87cb-63007454f903 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.153229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ee965-dede-416f-87cb-63007454f903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:28.157855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ee965-dede-416f-87cb-63007454f903 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:28.172481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 833/1646] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:28.174016 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965c57c-8d00-4111-ab8d-b135aa3defe7 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.174428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965c57c-8d00-4111-ab8d-b135aa3defe7 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.174782 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965c57c-8d00-4111-ab8d-b135aa3defe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.182845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2b7f0-71b0-435e-a888-87cabe3b57a0 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:28.189396 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a117be2-57da-44d8-8753-b4820fd5a87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:28.190421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a117be2-57da-44d8-8753-b4820fd5a87f admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.190791 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a117be2-57da-44d8-8753-b4820fd5a87f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.191138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a117be2-57da-44d8-8753-b4820fd5a87f admin admin] PATH_INFO: `/v3/projects/7dfe737514c34667bcd39ef78376890a/users/5f372abca9bf40eb88d93b0115606e32/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.197284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a117be2-57da-44d8-8753-b4820fd5a87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfe737514c34667bcd39ef78376890a, user_id=5f372abca9bf40eb88d93b0115606e32, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:28.200277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a117be2-57da-44d8-8753-b4820fd5a87f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:28.214593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 814/1647] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:28 2022] PUT /identity/v3/projects/7dfe737514c34667bcd39ef78376890a/users/5f372abca9bf40eb88d93b0115606e32/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:28.215250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a117be2-57da-44d8-8753-b4820fd5a87f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:28.220294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f965c57c-8d00-4111-ab8d-b135aa3defe7 None None] MFA Rules not processed for user `9c836181c45e46739bef7f6ae91ba1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:28.222431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f965c57c-8d00-4111-ab8d-b135aa3defe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:28.317543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a117be2-57da-44d8-8753-b4820fd5a87f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:28.326202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c5952-817f-44b7-8251-da70d6b6ff49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:28.326946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c5952-817f-44b7-8251-da70d6b6ff49 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.327263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c5952-817f-44b7-8251-da70d6b6ff49 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.327558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c5952-817f-44b7-8251-da70d6b6ff49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.352584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 834/1648] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:28 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:28.354962 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9549-ce23-4da0-b1da-2def0c33fbb2 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.355874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9549-ce23-4da0-b1da-2def0c33fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.356256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9549-ce23-4da0-b1da-2def0c33fbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.381361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4d9b9549-ce23-4da0-b1da-2def0c33fbb2 None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:28.385850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4d9b9549-ce23-4da0-b1da-2def0c33fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:28.434691 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c5952-817f-44b7-8251-da70d6b6ff49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:28.437199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c5952-817f-44b7-8251-da70d6b6ff49 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:28.454140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 815/1649] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:28.455121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c5952-817f-44b7-8251-da70d6b6ff49 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:28.489719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 835/1650] 10.222.0.20 () {58 vars in 1056 bytes} [Fri Oct 28 19:52:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:28.491495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334ec4-4e63-4cf0-981c-b2071bb470c0 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.492157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334ec4-4e63-4cf0-981c-b2071bb470c0 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.492932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334ec4-4e63-4cf0-981c-b2071bb470c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.525678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-89334ec4-4e63-4cf0-981c-b2071bb470c0 None None] MFA Rules not processed for user `5f372abca9bf40eb88d93b0115606e32`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:28.526550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-89334ec4-4e63-4cf0-981c-b2071bb470c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:28.551903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c5952-817f-44b7-8251-da70d6b6ff49 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:28.558784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf02528-830d-4f4e-b5d5-945ee0d2b51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:28.559909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf02528-830d-4f4e-b5d5-945ee0d2b51e admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.560482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf02528-830d-4f4e-b5d5-945ee0d2b51e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.560828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf02528-830d-4f4e-b5d5-945ee0d2b51e admin admin] PATH_INFO: `/v3/projects/895f558c24584c6aa8b89586c928b0fd/users/bd0f951702e64a329a37c1f54b96fb87/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.565810 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf02528-830d-4f4e-b5d5-945ee0d2b51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=895f558c24584c6aa8b89586c928b0fd, user_id=bd0f951702e64a329a37c1f54b96fb87, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:28.569046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf02528-830d-4f4e-b5d5-945ee0d2b51e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:28.588906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 816/1651] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:28 2022] PUT /identity/v3/projects/895f558c24584c6aa8b89586c928b0fd/users/bd0f951702e64a329a37c1f54b96fb87/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:28.589876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf02528-830d-4f4e-b5d5-945ee0d2b51e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:28.610589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 836/1652] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:28 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:28.612098 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0387b5-54e8-4070-851e-51d6676fc7d4 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.612487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0387b5-54e8-4070-851e-51d6676fc7d4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.612862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0387b5-54e8-4070-851e-51d6676fc7d4 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.620920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 837/1653] 10.222.0.20 () {54 vars in 912 bytes} [Fri Oct 28 19:52:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:28.622548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c0efa-bdf2-4db9-81e8-b422b927d526 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.623155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c0efa-bdf2-4db9-81e8-b422b927d526 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.623155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c0efa-bdf2-4db9-81e8-b422b927d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.656384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-986c0efa-bdf2-4db9-81e8-b422b927d526 None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:28.657923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-986c0efa-bdf2-4db9-81e8-b422b927d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:28.693440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf02528-830d-4f4e-b5d5-945ee0d2b51e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:28.701243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3e70-f443-43fc-93f3-2c2a26aefd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:28.703436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3e70-f443-43fc-93f3-2c2a26aefd4a service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.703732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3e70-f443-43fc-93f3-2c2a26aefd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.704008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3e70-f443-43fc-93f3-2c2a26aefd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.781468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 838/1654] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:52:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:28.783096 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c0efa-bdf2-4db9-81e8-b422b927d526 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:28.798278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c0efa-bdf2-4db9-81e8-b422b927d526 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:28.803155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dbb1d-5a19-4273-bd58-4f3897bde41b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:28.804134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dbb1d-5a19-4273-bd58-4f3897bde41b service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.804781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dbb1d-5a19-4273-bd58-4f3897bde41b service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.805299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dbb1d-5a19-4273-bd58-4f3897bde41b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.841046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3e70-f443-43fc-93f3-2c2a26aefd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:28.845503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3e70-f443-43fc-93f3-2c2a26aefd4a service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:28.866648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 817/1655] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:28.888079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dbb1d-5a19-4273-bd58-4f3897bde41b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:28.889742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dbb1d-5a19-4273-bd58-4f3897bde41b service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:28.900930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 839/1656] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:28.964141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3e70-f443-43fc-93f3-2c2a26aefd4a service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:28.981841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3e70-f443-43fc-93f3-2c2a26aefd4a service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:28.985543 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dbb1d-5a19-4273-bd58-4f3897bde41b service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:28.987653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e6d4c-aac3-4dcd-811c-776ba1531b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:28.989099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e6d4c-aac3-4dcd-811c-776ba1531b0e service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:28.989580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e6d4c-aac3-4dcd-811c-776ba1531b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:28.990033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e6d4c-aac3-4dcd-811c-776ba1531b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:28.999003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dbb1d-5a19-4273-bd58-4f3897bde41b service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:29.007739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79964e91-459a-494a-b32f-5e74308537dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:29.008530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79964e91-459a-494a-b32f-5e74308537dc service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:29.008887 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79964e91-459a-494a-b32f-5e74308537dc service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:29.009229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79964e91-459a-494a-b32f-5e74308537dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:29.032557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79964e91-459a-494a-b32f-5e74308537dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:29.034158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79964e91-459a-494a-b32f-5e74308537dc service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:29.064660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 840/1657] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:52:29.079277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e6d4c-aac3-4dcd-811c-776ba1531b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:29.081186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e6d4c-aac3-4dcd-811c-776ba1531b0e service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:29.094370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 818/1658] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:29.262667 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c52a-7af2-43f3-9bab-8d0903e2413b None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:29.263138 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c52a-7af2-43f3-9bab-8d0903e2413b None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:29.263563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c52a-7af2-43f3-9bab-8d0903e2413b None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:29.265970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 841/1659] 10.222.0.20 () {54 vars in 912 bytes} [Fri Oct 28 19:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:29.273095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e6d4c-aac3-4dcd-811c-776ba1531b0e service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:29.283577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e6d4c-aac3-4dcd-811c-776ba1531b0e service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:29.290922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36eba3-3098-4fd3-88da-7feabc87836c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:29.291208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36eba3-3098-4fd3-88da-7feabc87836c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:29.291602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36eba3-3098-4fd3-88da-7feabc87836c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:29.301553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088ee92-1bb8-4faf-bd96-83ee1ef4eef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:29.306717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ee92-1bb8-4faf-bd96-83ee1ef4eef4 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:29.307008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ee92-1bb8-4faf-bd96-83ee1ef4eef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:29.307289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ee92-1bb8-4faf-bd96-83ee1ef4eef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:29.319813 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-dc36eba3-3098-4fd3-88da-7feabc87836c None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:29.321056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-dc36eba3-3098-4fd3-88da-7feabc87836c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:29.351713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 842/1660] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:52:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 28 19:52:29.480400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088ee92-1bb8-4faf-bd96-83ee1ef4eef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:29.482451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088ee92-1bb8-4faf-bd96-83ee1ef4eef4 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:29.486841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36eba3-3098-4fd3-88da-7feabc87836c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:29.498658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36eba3-3098-4fd3-88da-7feabc87836c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:29.504420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7947f27-e380-4fe6-bca1-9281d4be35b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:29.505725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7947f27-e380-4fe6-bca1-9281d4be35b8 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:29.506454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7947f27-e380-4fe6-bca1-9281d4be35b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:29.507128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7947f27-e380-4fe6-bca1-9281d4be35b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:29.512858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 819/1661] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:29.546906 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7947f27-e380-4fe6-bca1-9281d4be35b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:29.553839 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7947f27-e380-4fe6-bca1-9281d4be35b8 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:29.584241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 843/1662] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:52:29.977147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088ee92-1bb8-4faf-bd96-83ee1ef4eef4 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:30.211423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088ee92-1bb8-4faf-bd96-83ee1ef4eef4 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:30.224617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:30.228250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:30.228554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:30.229431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] PATH_INFO: `/v3/users/f212486a7e4c4945b5c97027a97e769e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:30.233564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f212486a7e4c4945b5c97027a97e769e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:30.236011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: WARNING py.warnings [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:52:30.236011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: warnings.warn(msg) Oct 28 19:52:30.236011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: Oct 28 19:52:30.239714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:30.398331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f212486a7e4c4945b5c97027a97e769e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:30.454829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f212486a7e4c4945b5c97027a97e769e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:30.456722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f212486a7e4c4945b5c97027a97e769e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:30.480570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f212486a7e4c4945b5c97027a97e769e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:30.481196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f212486a7e4c4945b5c97027a97e769e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:30.527092 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 820/1663] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:29 2022] DELETE /identity/v3/users/f212486a7e4c4945b5c97027a97e769e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:30.545441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2ed29-ce81-418c-b42a-f3d7af66262f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:30.546072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2ed29-ce81-418c-b42a-f3d7af66262f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:30.546072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2ed29-ce81-418c-b42a-f3d7af66262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:30.581727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-72b2ed29-ce81-418c-b42a-f3d7af66262f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:30.583057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-72b2ed29-ce81-418c-b42a-f3d7af66262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:30.722321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 844/1664] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:30.805080 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:30.806736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:30.950011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2f88-600e-45b4-ace7-9bcde85ed357 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:30.957570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374f313-19a7-4437-96a4-87036a422c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:30.958324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374f313-19a7-4437-96a4-87036a422c8c service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:30.958582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374f313-19a7-4437-96a4-87036a422c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:30.958859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374f313-19a7-4437-96a4-87036a422c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:30.981184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374f313-19a7-4437-96a4-87036a422c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:30.982807 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374f313-19a7-4437-96a4-87036a422c8c service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:31.054897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 821/1665] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:32.021178 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f984c-d691-4555-b6f9-59b9d681eed9 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:32.021666 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f984c-d691-4555-b6f9-59b9d681eed9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:32.021759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f984c-d691-4555-b6f9-59b9d681eed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:32.081950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ab9f984c-d691-4555-b6f9-59b9d681eed9 None None] MFA Rules not processed for user `bd0f951702e64a329a37c1f54b96fb87`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:32.083842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ab9f984c-d691-4555-b6f9-59b9d681eed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:32.277441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 845/1666] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:33.528133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374f313-19a7-4437-96a4-87036a422c8c service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:33.529674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f374f313-19a7-4437-96a4-87036a422c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:33.561310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374f313-19a7-4437-96a4-87036a422c8c service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:33.583151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:33.584803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:33.585417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:33.586301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] PATH_INFO: `/v3/projects/921d37b3427046159478a9f855327015` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:33.589621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=921d37b3427046159478a9f855327015)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:33.595677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:33.737466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921d37b3427046159478a9f855327015', 'request_id': 'req-30f23e07-43ca-4586-8b49-d7424ae73346'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:33.753557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921d37b3427046159478a9f855327015', 'request_id': 'req-30f23e07-43ca-4586-8b49-d7424ae73346'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:33.768904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921d37b3427046159478a9f855327015', 'request_id': 'req-30f23e07-43ca-4586-8b49-d7424ae73346'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:33.785404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] The token cache is being invalidate because project 921d37b3427046159478a9f855327015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:33.785968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:33.786867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-30f23e07-43ca-4586-8b49-d7424ae73346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:33.795430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 822/1667] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:33 2022] DELETE /identity/v3/projects/921d37b3427046159478a9f855327015 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:33.796860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9c9a-7ffd-44ff-bd99-f50f28f503a1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:33.797342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9c9a-7ffd-44ff-bd99-f50f28f503a1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:33.797409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9c9a-7ffd-44ff-bd99-f50f28f503a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:33.831514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-631b9c9a-7ffd-44ff-bd99-f50f28f503a1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:33.834977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-631b9c9a-7ffd-44ff-bd99-f50f28f503a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:34.013701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 846/1668] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:52:34.021843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b75ab-c0c0-4f27-a1cb-421d13553c45 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.022161 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b75ab-c0c0-4f27-a1cb-421d13553c45 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.022444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b75ab-c0c0-4f27-a1cb-421d13553c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.057943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-206b75ab-c0c0-4f27-a1cb-421d13553c45 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:34.067772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-206b75ab-c0c0-4f27-a1cb-421d13553c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:34.098435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9c9a-7ffd-44ff-bd99-f50f28f503a1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:34.114841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 823/1669] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:34.116475 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9c9a-7ffd-44ff-bd99-f50f28f503a1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:34.131894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7ca9-d81c-411c-b275-ace352d25c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:34.136678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7ca9-d81c-411c-b275-ace352d25c44 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.137149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7ca9-d81c-411c-b275-ace352d25c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.139953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7ca9-d81c-411c-b275-ace352d25c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.142266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e7ca9-d81c-411c-b275-ace352d25c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:34.149481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e7ca9-d81c-411c-b275-ace352d25c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:34.151445 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e7ca9-d81c-411c-b275-ace352d25c44 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:34.196552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 847/1670] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:34.197999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b75ab-c0c0-4f27-a1cb-421d13553c45 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:34.210874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b75ab-c0c0-4f27-a1cb-421d13553c45 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:34.232608 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cbecf-fdd1-4321-b66a-bde56771792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:34.233625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cbecf-fdd1-4321-b66a-bde56771792f admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.234421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cbecf-fdd1-4321-b66a-bde56771792f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.235692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cbecf-fdd1-4321-b66a-bde56771792f admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.238815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cbecf-fdd1-4321-b66a-bde56771792f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:34.248987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cbecf-fdd1-4321-b66a-bde56771792f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:34.266392 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7ca9-d81c-411c-b275-ace352d25c44 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:34.268538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-de3e7ca9-d81c-411c-b275-ace352d25c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:34.293011 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7ca9-d81c-411c-b275-ace352d25c44 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:34.310287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:34.311312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.311711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.312058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] PATH_INFO: `/v3/users/2b3621c2bde14f16a473675c0f63640c` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.313789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3621c2bde14f16a473675c0f63640c)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:34.315978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:34.349030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 824/1671] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:34 2022] POST /identity/v3/projects => generated 357 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:34.351976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cbecf-fdd1-4321-b66a-bde56771792f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:34.448535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3621c2bde14f16a473675c0f63640c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:34.495516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3621c2bde14f16a473675c0f63640c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:34.496318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3621c2bde14f16a473675c0f63640c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:34.496954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3621c2bde14f16a473675c0f63640c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:34.512606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-94b9f155-8d10-4a6b-ac41-c128456b3456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3621c2bde14f16a473675c0f63640c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:34.528328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cbecf-fdd1-4321-b66a-bde56771792f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:34.530494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 848/1672] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:34 2022] DELETE /identity/v3/users/2b3621c2bde14f16a473675c0f63640c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:52:34.535211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db4ae5-a072-4f13-a2ea-da63eee3490e None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.536170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db4ae5-a072-4f13-a2ea-da63eee3490e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.536581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db4ae5-a072-4f13-a2ea-da63eee3490e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.565860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-12db4ae5-a072-4f13-a2ea-da63eee3490e None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:34.568307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-12db4ae5-a072-4f13-a2ea-da63eee3490e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:34.634783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1906682-9448-4a7d-a558-20494c4e3491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:34.636479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1906682-9448-4a7d-a558-20494c4e3491 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.636993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1906682-9448-4a7d-a558-20494c4e3491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.637351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1906682-9448-4a7d-a558-20494c4e3491 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.641881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1906682-9448-4a7d-a558-20494c4e3491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:34.641881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1906682-9448-4a7d-a558-20494c4e3491 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:34.687397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 825/1673] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:34 2022] POST /identity/v3/users => generated 279 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:34.690878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1906682-9448-4a7d-a558-20494c4e3491 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:34.695018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b1906682-9448-4a7d-a558-20494c4e3491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:34.709878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 849/1674] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:52:34.729745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1906682-9448-4a7d-a558-20494c4e3491 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:34.741098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56367265-ce23-476f-b080-b6819acb270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:34.741712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367265-ce23-476f-b080-b6819acb270b admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.742004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367265-ce23-476f-b080-b6819acb270b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.742311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367265-ce23-476f-b080-b6819acb270b admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.743056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56367265-ce23-476f-b080-b6819acb270b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:34.744814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56367265-ce23-476f-b080-b6819acb270b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:34.768817 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 826/1675] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:34.770176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db4ae5-a072-4f13-a2ea-da63eee3490e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:34.783346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56367265-ce23-476f-b080-b6819acb270b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:34.787236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db4ae5-a072-4f13-a2ea-da63eee3490e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:34.790185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-56367265-ce23-476f-b080-b6819acb270b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:34.803932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df5591-1f5a-4205-8677-ba3f1ca32a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:34.812594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5591-1f5a-4205-8677-ba3f1ca32a2d admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.812959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5591-1f5a-4205-8677-ba3f1ca32a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.813244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5591-1f5a-4205-8677-ba3f1ca32a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.816535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df5591-1f5a-4205-8677-ba3f1ca32a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:34.823469 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df5591-1f5a-4205-8677-ba3f1ca32a2d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:34.856083 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 850/1676] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:34.857261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df5591-1f5a-4205-8677-ba3f1ca32a2d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:34.880114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df5591-1f5a-4205-8677-ba3f1ca32a2d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:34.890433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52f879-fdfb-4bee-8e76-d378273f0f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:34.892326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f879-fdfb-4bee-8e76-d378273f0f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.894492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f879-fdfb-4bee-8e76-d378273f0f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.895076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f879-fdfb-4bee-8e76-d378273f0f63 admin admin] PATH_INFO: `/v3/projects/c355884383f94fe7aa84d43abed91572/users/36d257a309794801a0da278cd06e436d/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.931558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52f879-fdfb-4bee-8e76-d378273f0f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c355884383f94fe7aa84d43abed91572, user_id=36d257a309794801a0da278cd06e436d, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:34.934698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52f879-fdfb-4bee-8e76-d378273f0f63 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:34.945467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56367265-ce23-476f-b080-b6819acb270b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:34.956984 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b3de8-8271-40d0-95aa-220a5731a325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:34.957656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b3de8-8271-40d0-95aa-220a5731a325 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.957936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b3de8-8271-40d0-95aa-220a5731a325 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.958310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b3de8-8271-40d0-95aa-220a5731a325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.961435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 851/1677] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:34 2022] PUT /identity/v3/projects/c355884383f94fe7aa84d43abed91572/users/36d257a309794801a0da278cd06e436d/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:34.973926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1ddc-bff8-497a-a1ed-3f343fd5a9ff None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:34.974692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1ddc-bff8-497a-a1ed-3f343fd5a9ff None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:34.975788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1ddc-bff8-497a-a1ed-3f343fd5a9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:34.978713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b3de8-8271-40d0-95aa-220a5731a325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:34.980190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b3de8-8271-40d0-95aa-220a5731a325 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:34.993784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 827/1678] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:34.994900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b3de8-8271-40d0-95aa-220a5731a325 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:34.996617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f77b3de8-8271-40d0-95aa-220a5731a325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:35.024122 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b3de8-8271-40d0-95aa-220a5731a325 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:35.027671 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-41cc1ddc-bff8-497a-a1ed-3f343fd5a9ff None None] MFA Rules not processed for user `36d257a309794801a0da278cd06e436d`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:35.029523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-41cc1ddc-bff8-497a-a1ed-3f343fd5a9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:35.121655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:35.123447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.123789 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.124363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] PATH_INFO: `/v3/users/d0156620c4bd42d781871ebfdd490150` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.125810 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0156620c4bd42d781871ebfdd490150)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:35.128100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:35.132342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 852/1679] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:35.136104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1ddc-bff8-497a-a1ed-3f343fd5a9ff None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:35.155009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1ddc-bff8-497a-a1ed-3f343fd5a9ff None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:35.165739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68697c-7c37-4b7d-a92e-9186eac2a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:35.167063 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68697c-7c37-4b7d-a92e-9186eac2a04c admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.168194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68697c-7c37-4b7d-a92e-9186eac2a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.168959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68697c-7c37-4b7d-a92e-9186eac2a04c admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.169932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68697c-7c37-4b7d-a92e-9186eac2a04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:35.175536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68697c-7c37-4b7d-a92e-9186eac2a04c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:35.219128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0156620c4bd42d781871ebfdd490150'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:35.246424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0156620c4bd42d781871ebfdd490150'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:35.247204 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 853/1680] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:35 2022] POST /identity/v3/projects => generated 355 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:35.247814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0156620c4bd42d781871ebfdd490150'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:35.251911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68697c-7c37-4b7d-a92e-9186eac2a04c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:35.267699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0156620c4bd42d781871ebfdd490150'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:35.268418 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-df3e9b0f-d099-4494-9a6a-d0199887917a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0156620c4bd42d781871ebfdd490150'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:35.291043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 828/1681] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:34 2022] DELETE /identity/v3/users/d0156620c4bd42d781871ebfdd490150 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:35.292526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da9cd7-49c4-4606-9fdb-ec9a92225b89 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.292910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da9cd7-49c4-4606-9fdb-ec9a92225b89 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.293255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da9cd7-49c4-4606-9fdb-ec9a92225b89 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.297282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 829/1682] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:52:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:35.302276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490fddb-30f3-4d01-8150-c7a989c3d4e2 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.302276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490fddb-30f3-4d01-8150-c7a989c3d4e2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.302276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490fddb-30f3-4d01-8150-c7a989c3d4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.339515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d490fddb-30f3-4d01-8150-c7a989c3d4e2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:35.340722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d490fddb-30f3-4d01-8150-c7a989c3d4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:35.382577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68697c-7c37-4b7d-a92e-9186eac2a04c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:35.465746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 830/1683] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:35.467762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121677f-b5a2-4b12-ae93-0b6819b77024 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.468835 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121677f-b5a2-4b12-ae93-0b6819b77024 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.477985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121677f-b5a2-4b12-ae93-0b6819b77024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.504693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5e828-f58e-4e3a-ab2f-303a66134637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:35.505696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5e828-f58e-4e3a-ab2f-303a66134637 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.505977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5e828-f58e-4e3a-ab2f-303a66134637 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.506272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5e828-f58e-4e3a-ab2f-303a66134637 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.506978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5e828-f58e-4e3a-ab2f-303a66134637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:35.508248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1121677f-b5a2-4b12-ae93-0b6819b77024 None None] MFA Rules not processed for user `4e04cc7f60894946aace79d4c2875f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:35.508929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5e828-f58e-4e3a-ab2f-303a66134637 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:35.510434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1121677f-b5a2-4b12-ae93-0b6819b77024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:35.561203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 854/1684] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:35 2022] POST /identity/v3/users => generated 284 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:52:35.561203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5e828-f58e-4e3a-ab2f-303a66134637 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:35.567577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-50c5e828-f58e-4e3a-ab2f-303a66134637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:35.643538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 831/1685] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:52:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:35.646310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121677f-b5a2-4b12-ae93-0b6819b77024 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:35.649105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1121677f-b5a2-4b12-ae93-0b6819b77024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:35.683351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121677f-b5a2-4b12-ae93-0b6819b77024 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:35.694413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea99a2-6afb-45e9-a6ea-d972e14cb0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:35.696026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea99a2-6afb-45e9-a6ea-d972e14cb0dd admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.696456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea99a2-6afb-45e9-a6ea-d972e14cb0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.696832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea99a2-6afb-45e9-a6ea-d972e14cb0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.698256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea99a2-6afb-45e9-a6ea-d972e14cb0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:35.700628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea99a2-6afb-45e9-a6ea-d972e14cb0dd admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:35.720840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 832/1686] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:35.722544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a260d73-3ec9-4aca-a1a4-759f39d6605a None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.723292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a260d73-3ec9-4aca-a1a4-759f39d6605a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.724306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a260d73-3ec9-4aca-a1a4-759f39d6605a None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.727900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 833/1687] 10.222.0.20 () {54 vars in 960 bytes} [Fri Oct 28 19:52:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:35.729131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a260d73-3ec9-4aca-a1a4-759f39d6605a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:35.729242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5e828-f58e-4e3a-ab2f-303a66134637 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:35.737548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9547b3-64c5-442d-adfb-d193793c67b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:35.738291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9547b3-64c5-442d-adfb-d193793c67b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.738572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9547b3-64c5-442d-adfb-d193793c67b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.738846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9547b3-64c5-442d-adfb-d193793c67b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.749817 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a260d73-3ec9-4aca-a1a4-759f39d6605a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:35.757661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433f2f-745b-4fa5-824c-22a1939ee213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:35.760028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433f2f-745b-4fa5-824c-22a1939ee213 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.760512 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433f2f-745b-4fa5-824c-22a1939ee213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.760866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433f2f-745b-4fa5-824c-22a1939ee213 admin admin] PATH_INFO: `/v3/projects/9fa74c9360e547c5951e417164a9e167/users/9f33506879b4483cb4b838ed588683ff/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.762731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9547b3-64c5-442d-adfb-d193793c67b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:35.764439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9547b3-64c5-442d-adfb-d193793c67b0 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:35.786370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13433f2f-745b-4fa5-824c-22a1939ee213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa74c9360e547c5951e417164a9e167, user_id=9f33506879b4483cb4b838ed588683ff, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:35.786905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 855/1688] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:35.787993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ae7a-1d0c-42e7-92b6-ed080a16258d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.788279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ae7a-1d0c-42e7-92b6-ed080a16258d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.788545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ae7a-1d0c-42e7-92b6-ed080a16258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.790335 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13433f2f-745b-4fa5-824c-22a1939ee213 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:35.835699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 834/1689] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:35 2022] PUT /identity/v3/projects/9fa74c9360e547c5951e417164a9e167/users/9f33506879b4483cb4b838ed588683ff/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:35.838649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-a123ae7a-1d0c-42e7-92b6-ed080a16258d None None] MFA Rules not processed for user `4e04cc7f60894946aace79d4c2875f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:35.838649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-a123ae7a-1d0c-42e7-92b6-ed080a16258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:35.844405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433f2f-745b-4fa5-824c-22a1939ee213 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:35.951154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 856/1690] 10.222.0.20 () {58 vars in 1057 bytes} [Fri Oct 28 19:52:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:35.960845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123ae7a-1d0c-42e7-92b6-ed080a16258d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:35.980490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123ae7a-1d0c-42e7-92b6-ed080a16258d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:35.984433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433f2f-745b-4fa5-824c-22a1939ee213 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:35.989226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1e1a1-4029-44e6-a53d-9d475c468c97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:35.990292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1e1a1-4029-44e6-a53d-9d475c468c97 service placement] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.990745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1e1a1-4029-44e6-a53d-9d475c468c97 service placement] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.991326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1e1a1-4029-44e6-a53d-9d475c468c97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.995491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e8eff-5b8b-4bc5-b3fd-a5e2f5d8c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:35.996873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e8eff-5b8b-4bc5-b3fd-a5e2f5d8c69a admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:35.997157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e8eff-5b8b-4bc5-b3fd-a5e2f5d8c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:35.997429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e8eff-5b8b-4bc5-b3fd-a5e2f5d8c69a admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:35.998202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e8eff-5b8b-4bc5-b3fd-a5e2f5d8c69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:36.002885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1e1a1-4029-44e6-a53d-9d475c468c97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:36.006225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1e1a1-4029-44e6-a53d-9d475c468c97 service placement] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:36.006776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e8eff-5b8b-4bc5-b3fd-a5e2f5d8c69a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:36.024404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 835/1691] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:36.025397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e8eff-5b8b-4bc5-b3fd-a5e2f5d8c69a admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:36.036749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 857/1692] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:36.043166 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e8eff-5b8b-4bc5-b3fd-a5e2f5d8c69a admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:36.049001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a2897-d2cf-4e50-afa5-9d6dee615128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:36.050370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a2897-d2cf-4e50-afa5-9d6dee615128 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:36.051011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a2897-d2cf-4e50-afa5-9d6dee615128 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:36.051481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a2897-d2cf-4e50-afa5-9d6dee615128 admin admin] PATH_INFO: `/v3/projects/9fa74c9360e547c5951e417164a9e167/users/9f33506879b4483cb4b838ed588683ff/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:36.054058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a2897-d2cf-4e50-afa5-9d6dee615128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa74c9360e547c5951e417164a9e167, user_id=9f33506879b4483cb4b838ed588683ff, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:36.057757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a2897-d2cf-4e50-afa5-9d6dee615128 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:36.075974 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 836/1693] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:36 2022] PUT /identity/v3/projects/9fa74c9360e547c5951e417164a9e167/users/9f33506879b4483cb4b838ed588683ff/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:36.088722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e4ed4-75b6-4e07-b622-6422f005fb11 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:36.089258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e4ed4-75b6-4e07-b622-6422f005fb11 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:36.090155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e4ed4-75b6-4e07-b622-6422f005fb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:36.158549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-613e4ed4-75b6-4e07-b622-6422f005fb11 None None] MFA Rules not processed for user `9f33506879b4483cb4b838ed588683ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:36.161510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-613e4ed4-75b6-4e07-b622-6422f005fb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:36.339177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 858/1694] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:36 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:36.360460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a2897-d2cf-4e50-afa5-9d6dee615128 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:36.363523 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-dd2a2897-d2cf-4e50-afa5-9d6dee615128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:36.523409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a2897-d2cf-4e50-afa5-9d6dee615128 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:36.529902 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd2b3e-2d90-4b5b-96cd-aa0ae4e364ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:36.533038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd2b3e-2d90-4b5b-96cd-aa0ae4e364ae service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:36.533318 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd2b3e-2d90-4b5b-96cd-aa0ae4e364ae service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:36.537588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd2b3e-2d90-4b5b-96cd-aa0ae4e364ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:36.561800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd2b3e-2d90-4b5b-96cd-aa0ae4e364ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:36.563294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd2b3e-2d90-4b5b-96cd-aa0ae4e364ae service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:36.590254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 837/1695] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:36 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:36.731997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e4ed4-75b6-4e07-b622-6422f005fb11 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:36.745655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e4ed4-75b6-4e07-b622-6422f005fb11 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:36.755641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe2bb9-2b7c-495e-8fee-ebe7867bbc5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:36.756308 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2bb9-2b7c-495e-8fee-ebe7867bbc5e service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:36.756653 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2bb9-2b7c-495e-8fee-ebe7867bbc5e service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:36.756856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2bb9-2b7c-495e-8fee-ebe7867bbc5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:36.762305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5fbe2bb9-2b7c-495e-8fee-ebe7867bbc5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:36.956479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47842f-2b44-4ce9-aeff-759e797f82f3 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:36.957608 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47842f-2b44-4ce9-aeff-759e797f82f3 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:36.958108 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47842f-2b44-4ce9-aeff-759e797f82f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:36.960440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe2bb9-2b7c-495e-8fee-ebe7867bbc5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:36.962786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe2bb9-2b7c-495e-8fee-ebe7867bbc5e service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:36.979205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 859/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:36 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:36.995031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe2bb9-2b7c-495e-8fee-ebe7867bbc5e service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:37.009822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5fbe2bb9-2b7c-495e-8fee-ebe7867bbc5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:37.018933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1e47842f-2b44-4ce9-aeff-759e797f82f3 None None] MFA Rules not processed for user `36c4bc5fb79b455fba3c684645fca939`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:37.020147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1e47842f-2b44-4ce9-aeff-759e797f82f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:37.238917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 838/1697] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:37.255188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47842f-2b44-4ce9-aeff-759e797f82f3 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:37.256650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1e47842f-2b44-4ce9-aeff-759e797f82f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:37.263930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe2bb9-2b7c-495e-8fee-ebe7867bbc5e service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:37.274513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:37.275417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:37.275693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:37.275986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] PATH_INFO: `/v3/users/54860d5403d2429f8293530cf8aacd77` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:37.277587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54860d5403d2429f8293530cf8aacd77)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:37.279598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:37.400023 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54860d5403d2429f8293530cf8aacd77'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.436400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54860d5403d2429f8293530cf8aacd77'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.437290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54860d5403d2429f8293530cf8aacd77'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.439512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54860d5403d2429f8293530cf8aacd77'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.462860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54860d5403d2429f8293530cf8aacd77'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.493693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 860/1698] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:36 2022] DELETE /identity/v3/users/54860d5403d2429f8293530cf8aacd77 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:37.493693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:37.498295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:37.499642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47842f-2b44-4ce9-aeff-759e797f82f3 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:37.605056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3f054-4a61-4699-a7d2-5d885366b44d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:37.614884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:37.617833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:37.619564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:37.619868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] PATH_INFO: `/v3/projects/c85b5b32e6ed4796a218c14ab2359d44` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:37.623931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85b5b32e6ed4796a218c14ab2359d44)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:37.626638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: WARNING py.warnings [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:52:37.626638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: warnings.warn(msg) Oct 28 19:52:37.626638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: Oct 28 19:52:37.631215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:37.665869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50601fb-23ed-49ca-be32-1d235a9d6a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:37.668603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50601fb-23ed-49ca-be32-1d235a9d6a98 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:37.668892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50601fb-23ed-49ca-be32-1d235a9d6a98 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:37.669216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50601fb-23ed-49ca-be32-1d235a9d6a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:37.672293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a50601fb-23ed-49ca-be32-1d235a9d6a98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:37.757912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50601fb-23ed-49ca-be32-1d235a9d6a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:37.760482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50601fb-23ed-49ca-be32-1d235a9d6a98 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:37.773054 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 839/1699] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:52:37.774244 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50601fb-23ed-49ca-be32-1d235a9d6a98 service nova] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:37.775764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a50601fb-23ed-49ca-be32-1d235a9d6a98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:37.791437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50601fb-23ed-49ca-be32-1d235a9d6a98 service nova] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:37.798881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85b5b32e6ed4796a218c14ab2359d44', 'request_id': 'req-e8bb2d1e-20bc-42d4-a74b-4485edad7259'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.836476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85b5b32e6ed4796a218c14ab2359d44', 'request_id': 'req-e8bb2d1e-20bc-42d4-a74b-4485edad7259'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.859429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:37.860417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:37.860687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85b5b32e6ed4796a218c14ab2359d44', 'request_id': 'req-e8bb2d1e-20bc-42d4-a74b-4485edad7259'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.860796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:37.860951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] PATH_INFO: `/v3/projects/5cf1e55335df4fff9fa32196310d6fd2` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:37.862433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf1e55335df4fff9fa32196310d6fd2)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:37.865079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:37.880128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] The token cache is being invalidate because project c85b5b32e6ed4796a218c14ab2359d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:37.884296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.885566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.889752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 861/1700] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:37 2022] DELETE /identity/v3/projects/c85b5b32e6ed4796a218c14ab2359d44 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:37.894588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:37.896068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:37.934776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf1e55335df4fff9fa32196310d6fd2', 'request_id': 'req-16c7b06c-59ce-4c89-b098-f4a1dff71f63'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.944326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf1e55335df4fff9fa32196310d6fd2', 'request_id': 'req-16c7b06c-59ce-4c89-b098-f4a1dff71f63'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.957035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb2d1e-20bc-42d4-a74b-4485edad7259 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:37.962289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf1e55335df4fff9fa32196310d6fd2', 'request_id': 'req-16c7b06c-59ce-4c89-b098-f4a1dff71f63'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:37.995716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] The token cache is being invalidate because project 5cf1e55335df4fff9fa32196310d6fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:37.996011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.001282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.005411 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 840/1701] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:37 2022] DELETE /identity/v3/projects/5cf1e55335df4fff9fa32196310d6fd2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:38.012063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:38.033042 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:38.104689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:38.107972 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:38.108456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:38.108994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] PATH_INFO: `/v3/users/5f372abca9bf40eb88d93b0115606e32` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:38.115163 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f372abca9bf40eb88d93b0115606e32)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:38.120157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:38.219410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b06c-59ce-4c89-b098-f4a1dff71f63 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:38.226813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:38.227848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:38.228185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:38.228464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] PATH_INFO: `/v3/users/9c836181c45e46739bef7f6ae91ba1f6` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:38.230896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c836181c45e46739bef7f6ae91ba1f6)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:38.233275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:38.239494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f372abca9bf40eb88d93b0115606e32'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.303915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f372abca9bf40eb88d93b0115606e32'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.304903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f372abca9bf40eb88d93b0115606e32'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.305827 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f372abca9bf40eb88d93b0115606e32'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.340894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f372abca9bf40eb88d93b0115606e32'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.356112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c836181c45e46739bef7f6ae91ba1f6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.372103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 862/1702] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:37 2022] DELETE /identity/v3/users/5f372abca9bf40eb88d93b0115606e32 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:38.372103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:38.372506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:38.384534 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c836181c45e46739bef7f6ae91ba1f6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.385688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c836181c45e46739bef7f6ae91ba1f6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.405244 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c836181c45e46739bef7f6ae91ba1f6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.405859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c836181c45e46739bef7f6ae91ba1f6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.429965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 841/1703] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:38 2022] DELETE /identity/v3/users/9c836181c45e46739bef7f6ae91ba1f6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:38.568287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fead99c-e600-42c3-b42e-56cd827d201c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:38.828254 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:38.829156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:38.830374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:38.830672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] PATH_INFO: `/v3/projects/ea23d43080634ad7b66faf8014e88112` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:38.835768 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea23d43080634ad7b66faf8014e88112)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:38.838421 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:38.939020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea23d43080634ad7b66faf8014e88112', 'request_id': 'req-415af536-f6e7-4115-a849-8904588e4b1c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.956984 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea23d43080634ad7b66faf8014e88112', 'request_id': 'req-415af536-f6e7-4115-a849-8904588e4b1c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:38.982558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea23d43080634ad7b66faf8014e88112', 'request_id': 'req-415af536-f6e7-4115-a849-8904588e4b1c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.017877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] The token cache is being invalidate because project ea23d43080634ad7b66faf8014e88112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:39.018210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.020137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.023273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 863/1704] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:38 2022] DELETE /identity/v3/projects/ea23d43080634ad7b66faf8014e88112 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:39.027224 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:39.030206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:39.058714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5b89a-ae12-4685-9dbb-acfa8760e3ec admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:39.249100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:39.250186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:39.250499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:39.250793 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] PATH_INFO: `/v3/users/bd0f951702e64a329a37c1f54b96fb87` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:39.253922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0f951702e64a329a37c1f54b96fb87)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:39.256167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:39.371230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0f951702e64a329a37c1f54b96fb87'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.416041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0f951702e64a329a37c1f54b96fb87'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.419888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0f951702e64a329a37c1f54b96fb87'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.439030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0f951702e64a329a37c1f54b96fb87'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.440550 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6536fdea-aef0-4216-9337-efaa360f0db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0f951702e64a329a37c1f54b96fb87'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.475070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 842/1705] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:39 2022] DELETE /identity/v3/users/bd0f951702e64a329a37c1f54b96fb87 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:39.590753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:39.592268 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:39.616325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415af536-f6e7-4115-a849-8904588e4b1c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:39.750992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:39.751905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:39.752181 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:39.752460 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] PATH_INFO: `/v3/projects/7dfe737514c34667bcd39ef78376890a` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:39.758533 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfe737514c34667bcd39ef78376890a)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:39.760515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:39.866995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfe737514c34667bcd39ef78376890a', 'request_id': 'req-0253c545-4643-4bfc-93d2-4d12c59e096c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.874168 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfe737514c34667bcd39ef78376890a', 'request_id': 'req-0253c545-4643-4bfc-93d2-4d12c59e096c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.887354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfe737514c34667bcd39ef78376890a', 'request_id': 'req-0253c545-4643-4bfc-93d2-4d12c59e096c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.915035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] The token cache is being invalidate because project 7dfe737514c34667bcd39ef78376890a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:39.915329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.917918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-0253c545-4643-4bfc-93d2-4d12c59e096c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:39.921614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 864/1706] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:39 2022] DELETE /identity/v3/projects/7dfe737514c34667bcd39ef78376890a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:39.926741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caa6b4-2ba1-43d7-bb16-52c16c3fae5a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:39.927071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caa6b4-2ba1-43d7-bb16-52c16c3fae5a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:39.927353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caa6b4-2ba1-43d7-bb16-52c16c3fae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:39.972955 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b9caa6b4-2ba1-43d7-bb16-52c16c3fae5a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:39.976436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b9caa6b4-2ba1-43d7-bb16-52c16c3fae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:40.125635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 843/1707] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:40.145250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6489-67e7-46d7-8816-5710e7d3b6f7 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:40.145542 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6489-67e7-46d7-8816-5710e7d3b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:40.145820 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6489-67e7-46d7-8816-5710e7d3b6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:40.170713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6dcf6489-67e7-46d7-8816-5710e7d3b6f7 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:40.172484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6dcf6489-67e7-46d7-8816-5710e7d3b6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:40.183000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caa6b4-2ba1-43d7-bb16-52c16c3fae5a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:40.184601 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b9caa6b4-2ba1-43d7-bb16-52c16c3fae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:40.197522 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 865/1708] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:40.204351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf6489-67e7-46d7-8816-5710e7d3b6f7 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:40.210738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caa6b4-2ba1-43d7-bb16-52c16c3fae5a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:40.223504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:40.224699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:40.226237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:40.227305 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] PATH_INFO: `/v3/projects/895f558c24584c6aa8b89586c928b0fd` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:40.229866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf6489-67e7-46d7-8816-5710e7d3b6f7 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:40.230365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=895f558c24584c6aa8b89586c928b0fd)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:40.235281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:40.246589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa86d-bcf3-4faf-ab15-feab0c8967e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:40.247884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa86d-bcf3-4faf-ab15-feab0c8967e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:40.249474 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa86d-bcf3-4faf-ab15-feab0c8967e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:40.249888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa86d-bcf3-4faf-ab15-feab0c8967e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:40.251025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fa86d-bcf3-4faf-ab15-feab0c8967e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:40.253647 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fa86d-bcf3-4faf-ab15-feab0c8967e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:40.255549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fa86d-bcf3-4faf-ab15-feab0c8967e3 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:40.287616 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 866/1709] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:40.295053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa86d-bcf3-4faf-ab15-feab0c8967e3 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:40.320243 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa86d-bcf3-4faf-ab15-feab0c8967e3 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:40.336155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599566c3-8ec1-4bce-be22-eee6350bfcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:40.337194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599566c3-8ec1-4bce-be22-eee6350bfcdd admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:40.339012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599566c3-8ec1-4bce-be22-eee6350bfcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:40.339251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599566c3-8ec1-4bce-be22-eee6350bfcdd admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:40.340707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599566c3-8ec1-4bce-be22-eee6350bfcdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:40.346109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599566c3-8ec1-4bce-be22-eee6350bfcdd admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:40.363709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895f558c24584c6aa8b89586c928b0fd', 'request_id': 'req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:40.381527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895f558c24584c6aa8b89586c928b0fd', 'request_id': 'req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:40.405436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895f558c24584c6aa8b89586c928b0fd', 'request_id': 'req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:40.421318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 867/1710] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:40 2022] POST /identity/v3/projects => generated 393 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:40.428313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599566c3-8ec1-4bce-be22-eee6350bfcdd admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:40.441060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] The token cache is being invalidate because project 895f558c24584c6aa8b89586c928b0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:40.442868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:40.445556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3ef03dd-7109-4d4c-bba8-5a78a2ba6b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:40.451852 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 844/1711] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:40 2022] DELETE /identity/v3/projects/895f558c24584c6aa8b89586c928b0fd => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:52:40.458677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66fd8e-1583-4fcb-b39a-e5c361e23330 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:40.459105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66fd8e-1583-4fcb-b39a-e5c361e23330 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:40.459514 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66fd8e-1583-4fcb-b39a-e5c361e23330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:40.526255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-3c66fd8e-1583-4fcb-b39a-e5c361e23330 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:40.528976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3c66fd8e-1583-4fcb-b39a-e5c361e23330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:40.647538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599566c3-8ec1-4bce-be22-eee6350bfcdd admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:40.667143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40adef-2b58-4cbc-b82a-b9b245996846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:40.668177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40adef-2b58-4cbc-b82a-b9b245996846 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:40.670415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40adef-2b58-4cbc-b82a-b9b245996846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:40.670838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40adef-2b58-4cbc-b82a-b9b245996846 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:40.671731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40adef-2b58-4cbc-b82a-b9b245996846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:40.679727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40adef-2b58-4cbc-b82a-b9b245996846 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:40.754720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 868/1712] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:40 2022] POST /identity/v3/users => generated 297 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:40.763390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40adef-2b58-4cbc-b82a-b9b245996846 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:40.773290 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 845/1713] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:40.774184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ac40adef-2b58-4cbc-b82a-b9b245996846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:40.776434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f52d6-1731-438b-b9e4-560756328707 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:40.777417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f52d6-1731-438b-b9e4-560756328707 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:40.778333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f52d6-1731-438b-b9e4-560756328707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:40.831976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40adef-2b58-4cbc-b82a-b9b245996846 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:40.847174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-8e0f52d6-1731-438b-b9e4-560756328707 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:40.856440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8e0f52d6-1731-438b-b9e4-560756328707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:40.860060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba8798-eb1d-4927-ab27-39e85ae69478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:40.860952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba8798-eb1d-4927-ab27-39e85ae69478 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:40.865933 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba8798-eb1d-4927-ab27-39e85ae69478 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:40.867293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba8798-eb1d-4927-ab27-39e85ae69478 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:40.869289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba8798-eb1d-4927-ab27-39e85ae69478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:40.876130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba8798-eb1d-4927-ab27-39e85ae69478 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:40.897442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 846/1714] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:40.897834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 869/1715] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:40.899336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f52d6-1731-438b-b9e4-560756328707 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:40.904186 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba8798-eb1d-4927-ab27-39e85ae69478 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:40.924194 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f52d6-1731-438b-b9e4-560756328707 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:40.925804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba8798-eb1d-4927-ab27-39e85ae69478 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:40.935249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee200d46-4d6d-43d2-b5ba-7dd65bb5dda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:40.936668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee200d46-4d6d-43d2-b5ba-7dd65bb5dda6 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:40.937807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199b1d9-1e53-42ca-ac53-3fe1682b483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:40.938665 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199b1d9-1e53-42ca-ac53-3fe1682b483b admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:40.939070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee200d46-4d6d-43d2-b5ba-7dd65bb5dda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:40.939671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee200d46-4d6d-43d2-b5ba-7dd65bb5dda6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:40.940654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee200d46-4d6d-43d2-b5ba-7dd65bb5dda6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:40.941073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199b1d9-1e53-42ca-ac53-3fe1682b483b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:40.941530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199b1d9-1e53-42ca-ac53-3fe1682b483b admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:40.944214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee200d46-4d6d-43d2-b5ba-7dd65bb5dda6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:40.945978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee200d46-4d6d-43d2-b5ba-7dd65bb5dda6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:40.946387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199b1d9-1e53-42ca-ac53-3fe1682b483b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:40.948376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199b1d9-1e53-42ca-ac53-3fe1682b483b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:40.983759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 870/1716] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:40.985114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199b1d9-1e53-42ca-ac53-3fe1682b483b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:40.987520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 847/1717] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:40.989479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee200d46-4d6d-43d2-b5ba-7dd65bb5dda6 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:40.993063 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c199b1d9-1e53-42ca-ac53-3fe1682b483b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:41.015831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee200d46-4d6d-43d2-b5ba-7dd65bb5dda6 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:41.022044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199b1d9-1e53-42ca-ac53-3fe1682b483b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:41.027389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f15440-5854-4249-b647-bd139f653106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:41.031635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f15440-5854-4249-b647-bd139f653106 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.032456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f15440-5854-4249-b647-bd139f653106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.033167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f15440-5854-4249-b647-bd139f653106 admin admin] PATH_INFO: `/v3/projects/9ce655afe7fb45b2b70ebcad9360343d/users/de5588548b8d424886556677ef3831db/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.036009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:41.037214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.038980 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.040176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] PATH_INFO: `/v3/projects/17724c8e60a74cfba610818de80e8291` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.044314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17724c8e60a74cfba610818de80e8291)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:41.059497 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:41.082036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f15440-5854-4249-b647-bd139f653106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce655afe7fb45b2b70ebcad9360343d, user_id=de5588548b8d424886556677ef3831db, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:41.090205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f15440-5854-4249-b647-bd139f653106 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:41.124547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 848/1718] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:40 2022] PUT /identity/v3/projects/9ce655afe7fb45b2b70ebcad9360343d/users/de5588548b8d424886556677ef3831db/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:41.134503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f15440-5854-4249-b647-bd139f653106 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:41.190009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17724c8e60a74cfba610818de80e8291', 'request_id': 'req-817a980a-462d-4187-b840-16a7e94c114c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:41.206230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17724c8e60a74cfba610818de80e8291', 'request_id': 'req-817a980a-462d-4187-b840-16a7e94c114c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:41.226888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17724c8e60a74cfba610818de80e8291', 'request_id': 'req-817a980a-462d-4187-b840-16a7e94c114c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:41.238673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f15440-5854-4249-b647-bd139f653106 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:41.247605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] The token cache is being invalidate because project 17724c8e60a74cfba610818de80e8291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:41.248035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:41.250180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:41.255780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 871/1719] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:40 2022] DELETE /identity/v3/projects/17724c8e60a74cfba610818de80e8291 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:41.256036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:41.259264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:41.316267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9807f-33ce-4418-9f04-a0aa3ff3964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:41.317141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9807f-33ce-4418-9f04-a0aa3ff3964f admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.317583 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9807f-33ce-4418-9f04-a0aa3ff3964f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.318207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9807f-33ce-4418-9f04-a0aa3ff3964f admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.319205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9807f-33ce-4418-9f04-a0aa3ff3964f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:41.322414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9807f-33ce-4418-9f04-a0aa3ff3964f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:41.360890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 849/1720] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:41 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:41.362551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673e4f5-e643-4043-9248-1c28ec46327f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.362973 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673e4f5-e643-4043-9248-1c28ec46327f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.364027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673e4f5-e643-4043-9248-1c28ec46327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.396649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e673e4f5-e643-4043-9248-1c28ec46327f None None] MFA Rules not processed for user `de5588548b8d424886556677ef3831db`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:41.398125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e673e4f5-e643-4043-9248-1c28ec46327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:41.414362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a980a-462d-4187-b840-16a7e94c114c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:41.509476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:41.510790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.511244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.511727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] PATH_INFO: `/v3/users/fcef95d389e34ac9a6ae68c7256cc0ce` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.513279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcef95d389e34ac9a6ae68c7256cc0ce)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:41.516534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:41.580506 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 850/1721] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:41.582383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc45a1-3d10-4af2-93a4-9eaf0d6c7453 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.582870 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc45a1-3d10-4af2-93a4-9eaf0d6c7453 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.583153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc45a1-3d10-4af2-93a4-9eaf0d6c7453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.594136 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcef95d389e34ac9a6ae68c7256cc0ce'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:41.605661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-8bdc45a1-3d10-4af2-93a4-9eaf0d6c7453 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:41.607098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8bdc45a1-3d10-4af2-93a4-9eaf0d6c7453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:41.617060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 851/1722] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:41.618518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6f4b8-2c6f-4e70-b39b-368e96ba9fe2 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.618802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6f4b8-2c6f-4e70-b39b-368e96ba9fe2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.619119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6f4b8-2c6f-4e70-b39b-368e96ba9fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.630406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcef95d389e34ac9a6ae68c7256cc0ce'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:41.631183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcef95d389e34ac9a6ae68c7256cc0ce'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:41.631991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcef95d389e34ac9a6ae68c7256cc0ce'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:41.646450 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcef95d389e34ac9a6ae68c7256cc0ce'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:41.673011 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 872/1723] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:41 2022] DELETE /identity/v3/users/fcef95d389e34ac9a6ae68c7256cc0ce => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:41.673943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0ea6f4b8-2c6f-4e70-b39b-368e96ba9fe2 None None] MFA Rules not processed for user `6c853d04dd5147f5961bf551b608da33`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:41.675188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0ea6f4b8-2c6f-4e70-b39b-368e96ba9fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:41.676771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:41.679285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:41.804571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d183269-5c00-45e2-94dc-9035e571c2b0 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:41.812182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc11be6-3c5f-44ec-8910-1672446b7b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:41.813346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc11be6-3c5f-44ec-8910-1672446b7b2c admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.813717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc11be6-3c5f-44ec-8910-1672446b7b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.813994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc11be6-3c5f-44ec-8910-1672446b7b2c admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.814746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc11be6-3c5f-44ec-8910-1672446b7b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:41.817110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc11be6-3c5f-44ec-8910-1672446b7b2c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:41.817614 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 852/1724] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:41.818227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6f4b8-2c6f-4e70-b39b-368e96ba9fe2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:41.825511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0ea6f4b8-2c6f-4e70-b39b-368e96ba9fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:41.846606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 873/1725] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:41 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:41.846606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52ddf6-3d67-4ccd-988f-0d0d307d285d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.846606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52ddf6-3d67-4ccd-988f-0d0d307d285d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.846606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52ddf6-3d67-4ccd-988f-0d0d307d285d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.852481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6f4b8-2c6f-4e70-b39b-368e96ba9fe2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:41.863902 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf09ef9-5399-4128-9b6b-ebf3d1e07385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:41.864928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf09ef9-5399-4128-9b6b-ebf3d1e07385 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.867476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf09ef9-5399-4128-9b6b-ebf3d1e07385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.868097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf09ef9-5399-4128-9b6b-ebf3d1e07385 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.869180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf09ef9-5399-4128-9b6b-ebf3d1e07385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:41.872845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf09ef9-5399-4128-9b6b-ebf3d1e07385 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:41.879755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-bf52ddf6-3d67-4ccd-988f-0d0d307d285d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:41.881248 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-bf52ddf6-3d67-4ccd-988f-0d0d307d285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:41.891189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 874/1726] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:41.892674 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee362eb-5577-464e-990d-688159a50df4 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.893018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee362eb-5577-464e-990d-688159a50df4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.893357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee362eb-5577-464e-990d-688159a50df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.931059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 853/1727] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:41 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:41.932672 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c4eb5-249e-436e-a952-a6ac3e65be0a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:41.932971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c4eb5-249e-436e-a952-a6ac3e65be0a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:41.933283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c4eb5-249e-436e-a952-a6ac3e65be0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:41.944762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-7ee362eb-5577-464e-990d-688159a50df4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:41.948527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7ee362eb-5577-464e-990d-688159a50df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:41.952962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-7d5c4eb5-249e-436e-a952-a6ac3e65be0a None None] MFA Rules not processed for user `6c853d04dd5147f5961bf551b608da33`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:41.954277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7d5c4eb5-249e-436e-a952-a6ac3e65be0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:42.078018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 875/1728] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:42.079127 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee362eb-5577-464e-990d-688159a50df4 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:42.081133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 854/1729] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:42.082404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c4eb5-249e-436e-a952-a6ac3e65be0a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:42.094615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c4eb5-249e-436e-a952-a6ac3e65be0a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:42.110293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b257cb-041c-47e8-b2ff-72a828109973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:42.110293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b257cb-041c-47e8-b2ff-72a828109973 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.110293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b257cb-041c-47e8-b2ff-72a828109973 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.110293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b257cb-041c-47e8-b2ff-72a828109973 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.110577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b257cb-041c-47e8-b2ff-72a828109973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:42.110577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b257cb-041c-47e8-b2ff-72a828109973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:42.110577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b257cb-041c-47e8-b2ff-72a828109973 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:42.119459 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee362eb-5577-464e-990d-688159a50df4 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:42.121089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 855/1730] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:42.125240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f084-40ab-4482-941c-7a1bf1620a2b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.125240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f084-40ab-4482-941c-7a1bf1620a2b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.125240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f084-40ab-4482-941c-7a1bf1620a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.133856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f788077-6810-490f-89fc-dff150c97a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:42.135028 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f788077-6810-490f-89fc-dff150c97a1c admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.135514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f788077-6810-490f-89fc-dff150c97a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.135878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f788077-6810-490f-89fc-dff150c97a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.136901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f788077-6810-490f-89fc-dff150c97a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:42.140413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f788077-6810-490f-89fc-dff150c97a1c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:42.153027 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 876/1731] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:42.154145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f788077-6810-490f-89fc-dff150c97a1c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:42.173578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f788077-6810-490f-89fc-dff150c97a1c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:42.181675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3b050-2d75-4004-aaa8-4deec0b49526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:42.182511 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3b050-2d75-4004-aaa8-4deec0b49526 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.183048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3b050-2d75-4004-aaa8-4deec0b49526 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.183523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3b050-2d75-4004-aaa8-4deec0b49526 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.184444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3b050-2d75-4004-aaa8-4deec0b49526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:42.187139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3b050-2d75-4004-aaa8-4deec0b49526 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:42.207277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-86b0f084-40ab-4482-941c-7a1bf1620a2b None None] MFA Rules not processed for user `2585c34309964e04b69e75f7d91baf25`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:42.208800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-86b0f084-40ab-4482-941c-7a1bf1620a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:42.225873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 877/1732] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:42 2022] POST /identity/v3/users => generated 303 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:42.227734 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa63e9-5f13-4cbb-a664-afa0d5026da6 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.228137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa63e9-5f13-4cbb-a664-afa0d5026da6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.228593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa63e9-5f13-4cbb-a664-afa0d5026da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.294307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-64aa63e9-5f13-4cbb-a664-afa0d5026da6 None None] MFA Rules not processed for user `36c4bc5fb79b455fba3c684645fca939`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:42.297679 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-64aa63e9-5f13-4cbb-a664-afa0d5026da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:42.302362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 856/1733] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:42.303321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0f084-40ab-4482-941c-7a1bf1620a2b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:42.304694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-86b0f084-40ab-4482-941c-7a1bf1620a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:42.385942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0f084-40ab-4482-941c-7a1bf1620a2b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:42.390462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdf619-0d6a-4740-b3e6-bfc5f6ee6ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:42.391528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdf619-0d6a-4740-b3e6-bfc5f6ee6ccf service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.391951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdf619-0d6a-4740-b3e6-bfc5f6ee6ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.392359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdf619-0d6a-4740-b3e6-bfc5f6ee6ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.393664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 878/1734] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:42.394779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa63e9-5f13-4cbb-a664-afa0d5026da6 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:42.396169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-64aa63e9-5f13-4cbb-a664-afa0d5026da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:42.404539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdf619-0d6a-4740-b3e6-bfc5f6ee6ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:42.407344 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdf619-0d6a-4740-b3e6-bfc5f6ee6ccf service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:42.419268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 857/1735] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:42.436423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdf619-0d6a-4740-b3e6-bfc5f6ee6ccf service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:42.449088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdf619-0d6a-4740-b3e6-bfc5f6ee6ccf service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:42.454408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa6cf9-67d9-4f7d-bbc9-ed65f2208fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:42.455089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6cf9-67d9-4f7d-bbc9-ed65f2208fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.455374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6cf9-67d9-4f7d-bbc9-ed65f2208fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.455646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6cf9-67d9-4f7d-bbc9-ed65f2208fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.456341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa6cf9-67d9-4f7d-bbc9-ed65f2208fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:42.458549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa6cf9-67d9-4f7d-bbc9-ed65f2208fa5 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:42.501555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 858/1736] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:42 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:42.503802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa6cf9-67d9-4f7d-bbc9-ed65f2208fa5 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:42.573274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa63e9-5f13-4cbb-a664-afa0d5026da6 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:42.666170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa6cf9-67d9-4f7d-bbc9-ed65f2208fa5 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:42.676260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63bb4c-9ed2-4a31-84d8-abe386cf549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:42.676958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63bb4c-9ed2-4a31-84d8-abe386cf549e admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.677239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63bb4c-9ed2-4a31-84d8-abe386cf549e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.677515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63bb4c-9ed2-4a31-84d8-abe386cf549e admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.678279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63bb4c-9ed2-4a31-84d8-abe386cf549e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:42.679928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63bb4c-9ed2-4a31-84d8-abe386cf549e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:42.715228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 859/1737] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:42.717342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5471ef-299a-407a-a8df-4ec59e348f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:42.718545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5471ef-299a-407a-a8df-4ec59e348f3c service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.718838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5471ef-299a-407a-a8df-4ec59e348f3c service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.719114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5471ef-299a-407a-a8df-4ec59e348f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.723936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63bb4c-9ed2-4a31-84d8-abe386cf549e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:42.763363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63bb4c-9ed2-4a31-84d8-abe386cf549e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:42.834243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0346b-6e53-4363-a584-b899d997ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:42.841274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0346b-6e53-4363-a584-b899d997ba27 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.841578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0346b-6e53-4363-a584-b899d997ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.841849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0346b-6e53-4363-a584-b899d997ba27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.842661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0346b-6e53-4363-a584-b899d997ba27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:42.851570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0346b-6e53-4363-a584-b899d997ba27 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:42.855391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5471ef-299a-407a-a8df-4ec59e348f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:42.860041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5471ef-299a-407a-a8df-4ec59e348f3c service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:42.879245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 879/1738] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:42.880836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e2517-4ca2-4ff0-88d4-df7a514aa03e None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.881292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e2517-4ca2-4ff0-88d4-df7a514aa03e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.881699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e2517-4ca2-4ff0-88d4-df7a514aa03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.906110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d92e2517-4ca2-4ff0-88d4-df7a514aa03e None None] MFA Rules not processed for user `2585c34309964e04b69e75f7d91baf25`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:42.906304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 860/1739] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:42.907051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0346b-6e53-4363-a584-b899d997ba27 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:42.907890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d92e2517-4ca2-4ff0-88d4-df7a514aa03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:42.945099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0346b-6e53-4363-a584-b899d997ba27 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:42.970527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2cbd7-99bd-4d92-bf80-92c5fae2faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:42.973078 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cbd7-99bd-4d92-bf80-92c5fae2faac admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:42.974988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cbd7-99bd-4d92-bf80-92c5fae2faac admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:42.975283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cbd7-99bd-4d92-bf80-92c5fae2faac admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:42.979020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2cbd7-99bd-4d92-bf80-92c5fae2faac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:42.988696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2cbd7-99bd-4d92-bf80-92c5fae2faac admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:43.041339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 880/1740] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:43.042514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e2517-4ca2-4ff0-88d4-df7a514aa03e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:43.067294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e2517-4ca2-4ff0-88d4-df7a514aa03e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:43.071476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 861/1741] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:42 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:43.073066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2cbd7-99bd-4d92-bf80-92c5fae2faac admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:43.081946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f067677-d55b-490e-bf72-dff715d463d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:43.082996 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f067677-d55b-490e-bf72-dff715d463d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:43.083233 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f067677-d55b-490e-bf72-dff715d463d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:43.083425 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f067677-d55b-490e-bf72-dff715d463d8 admin admin] PATH_INFO: `/v3/projects/63151e803e50473b83d6d880baa3f359/users/5cb4c3edd8524c299d868cc4eddeae7c/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:43.115894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2cbd7-99bd-4d92-bf80-92c5fae2faac admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:43.138758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f067677-d55b-490e-bf72-dff715d463d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63151e803e50473b83d6d880baa3f359, user_id=5cb4c3edd8524c299d868cc4eddeae7c, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:43.141625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f067677-d55b-490e-bf72-dff715d463d8 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:43.174776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d804a-2a5e-4220-a4da-e354de9f5727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:43.177208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d804a-2a5e-4220-a4da-e354de9f5727 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:43.177494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d804a-2a5e-4220-a4da-e354de9f5727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:43.182013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d804a-2a5e-4220-a4da-e354de9f5727 admin admin] PATH_INFO: `/v3/projects/8a9ac3f0cfbb47a09489b549f77f13ca/users/d22234c3873141dfa7445676653e3abd/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:43.191689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 881/1742] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:43 2022] PUT /identity/v3/projects/63151e803e50473b83d6d880baa3f359/users/5cb4c3edd8524c299d868cc4eddeae7c/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:43.193061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f067677-d55b-490e-bf72-dff715d463d8 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:43.249075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d804a-2a5e-4220-a4da-e354de9f5727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9ac3f0cfbb47a09489b549f77f13ca, user_id=d22234c3873141dfa7445676653e3abd, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:43.270269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d804a-2a5e-4220-a4da-e354de9f5727 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:43.306891 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 862/1743] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:43 2022] PUT /identity/v3/projects/8a9ac3f0cfbb47a09489b549f77f13ca/users/d22234c3873141dfa7445676653e3abd/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:43.315270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9473-c54c-4cfe-889c-a2e2fc534e5f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:43.315570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9473-c54c-4cfe-889c-a2e2fc534e5f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:43.315817 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b9473-c54c-4cfe-889c-a2e2fc534e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:43.382637 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-4c7b9473-c54c-4cfe-889c-a2e2fc534e5f None None] MFA Rules not processed for user `5cb4c3edd8524c299d868cc4eddeae7c`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:43.383873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4c7b9473-c54c-4cfe-889c-a2e2fc534e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:43.469543 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f067677-d55b-490e-bf72-dff715d463d8 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:43.497800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 863/1744] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:43.500275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b9473-c54c-4cfe-889c-a2e2fc534e5f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:43.501827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4c7b9473-c54c-4cfe-889c-a2e2fc534e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:43.636774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aeac1-2351-42ab-a4b7-8361ce2def28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:43.637478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aeac1-2351-42ab-a4b7-8361ce2def28 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:43.638152 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aeac1-2351-42ab-a4b7-8361ce2def28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:43.638152 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aeac1-2351-42ab-a4b7-8361ce2def28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:43.638806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3aeac1-2351-42ab-a4b7-8361ce2def28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:43.640581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3aeac1-2351-42ab-a4b7-8361ce2def28 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:43.644417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b9473-c54c-4cfe-889c-a2e2fc534e5f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:43.666811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:43.667877 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:43.668315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:43.669429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] PATH_INFO: `/v3/projects/efdb1671bef84ba3a45bc253adb78693` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:43.669604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 882/1745] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:43.670563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aeac1-2351-42ab-a4b7-8361ce2def28 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:43.674650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efdb1671bef84ba3a45bc253adb78693)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:43.676832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:43.694158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aeac1-2351-42ab-a4b7-8361ce2def28 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:43.703485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a419c-60a8-4312-a0f6-8af4798ab356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:43.704187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a419c-60a8-4312-a0f6-8af4798ab356 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:43.704471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a419c-60a8-4312-a0f6-8af4798ab356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:43.704749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a419c-60a8-4312-a0f6-8af4798ab356 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:43.705499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a419c-60a8-4312-a0f6-8af4798ab356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:43.707166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a419c-60a8-4312-a0f6-8af4798ab356 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:43.729937 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 883/1746] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:43.730899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a419c-60a8-4312-a0f6-8af4798ab356 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:43.755984 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a419c-60a8-4312-a0f6-8af4798ab356 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:43.762116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd31e8-dad7-478b-9663-1d75206b5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:43.763058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd31e8-dad7-478b-9663-1d75206b5dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:43.763512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd31e8-dad7-478b-9663-1d75206b5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:43.763955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd31e8-dad7-478b-9663-1d75206b5dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:43.765102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd31e8-dad7-478b-9663-1d75206b5dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:43.771121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd31e8-dad7-478b-9663-1d75206b5dc4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:43.794422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efdb1671bef84ba3a45bc253adb78693', 'request_id': 'req-c315223d-de88-4954-83e6-e39fe069cea0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:43.806498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efdb1671bef84ba3a45bc253adb78693', 'request_id': 'req-c315223d-de88-4954-83e6-e39fe069cea0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:43.813560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 884/1747] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:43 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:43.821378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd31e8-dad7-478b-9663-1d75206b5dc4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:43.826776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efdb1671bef84ba3a45bc253adb78693', 'request_id': 'req-c315223d-de88-4954-83e6-e39fe069cea0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:43.865013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] The token cache is being invalidate because project efdb1671bef84ba3a45bc253adb78693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:43.865950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:43.869450 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:43.877664 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 864/1748] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:43 2022] DELETE /identity/v3/projects/efdb1671bef84ba3a45bc253adb78693 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:43.879411 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:43.881512 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:43.929755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd31e8-dad7-478b-9663-1d75206b5dc4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:43.937350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9f01-14c0-4070-8fcf-b072533705c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:43.938929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9f01-14c0-4070-8fcf-b072533705c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:43.939219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9f01-14c0-4070-8fcf-b072533705c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:43.939500 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9f01-14c0-4070-8fcf-b072533705c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:43.941057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba9f01-14c0-4070-8fcf-b072533705c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:43.943557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba9f01-14c0-4070-8fcf-b072533705c3 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:43.959078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 885/1749] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:43.960151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9f01-14c0-4070-8fcf-b072533705c3 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:43.962885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-abba9f01-14c0-4070-8fcf-b072533705c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:43.966239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315223d-de88-4954-83e6-e39fe069cea0 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:43.971289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2893c-1907-4d2a-8b47-0f09ef2acb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:43.972662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2893c-1907-4d2a-8b47-0f09ef2acb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:43.973156 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2893c-1907-4d2a-8b47-0f09ef2acb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:43.973615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2893c-1907-4d2a-8b47-0f09ef2acb1a admin admin] PATH_INFO: `/v3/projects/8a9ac3f0cfbb47a09489b549f77f13ca/users/d22234c3873141dfa7445676653e3abd/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:43.976607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2893c-1907-4d2a-8b47-0f09ef2acb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9ac3f0cfbb47a09489b549f77f13ca, user_id=d22234c3873141dfa7445676653e3abd, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:43.977826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9f01-14c0-4070-8fcf-b072533705c3 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:43.980282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2893c-1907-4d2a-8b47-0f09ef2acb1a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:43.995320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce427b76-7c71-49b1-a927-c45b07ebc435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:43.998260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 865/1750] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:43 2022] PUT /identity/v3/projects/8a9ac3f0cfbb47a09489b549f77f13ca/users/d22234c3873141dfa7445676653e3abd/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:43.998361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce427b76-7c71-49b1-a927-c45b07ebc435 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:43.998361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce427b76-7c71-49b1-a927-c45b07ebc435 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:43.998361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce427b76-7c71-49b1-a927-c45b07ebc435 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:43.998606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2893c-1907-4d2a-8b47-0f09ef2acb1a admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:43.998684 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce427b76-7c71-49b1-a927-c45b07ebc435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:43.998920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce427b76-7c71-49b1-a927-c45b07ebc435 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:44.023781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0ce2893c-1907-4d2a-8b47-0f09ef2acb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.043119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 886/1751] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:43 2022] POST /identity/v3/users => generated 293 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:44.046444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63c268-a776-4db2-a398-88ea5f08654c None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.046886 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63c268-a776-4db2-a398-88ea5f08654c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.047167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63c268-a776-4db2-a398-88ea5f08654c None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.050215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 887/1752] 10.222.0.20 () {54 vars in 912 bytes} [Fri Oct 28 19:52:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:44.057436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63c268-a776-4db2-a398-88ea5f08654c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:44.059175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9b63c268-a776-4db2-a398-88ea5f08654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.136698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2893c-1907-4d2a-8b47-0f09ef2acb1a admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:44.142032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:44.143198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.143671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.144186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] PATH_INFO: `/v3/users/ee720dc4ed424e6dbc0543aa47611a78` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.146205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee720dc4ed424e6dbc0543aa47611a78)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:44.148798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:44.182784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63c268-a776-4db2-a398-88ea5f08654c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:44.194973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979ee70-d5e8-42ef-b234-bf2e30da20a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:44.195682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979ee70-d5e8-42ef-b234-bf2e30da20a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.196024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979ee70-d5e8-42ef-b234-bf2e30da20a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.196304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979ee70-d5e8-42ef-b234-bf2e30da20a0 admin admin] PATH_INFO: `/v3/projects/8c8ee0b1420f44d9bc5e666d0fb2f531/users/3b16a0ab91eb4613b564c69aa1e816a9/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.226531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee720dc4ed424e6dbc0543aa47611a78'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:44.241051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979ee70-d5e8-42ef-b234-bf2e30da20a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8ee0b1420f44d9bc5e666d0fb2f531, user_id=3b16a0ab91eb4613b564c69aa1e816a9, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:44.242056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee720dc4ed424e6dbc0543aa47611a78'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:44.242817 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee720dc4ed424e6dbc0543aa47611a78'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:44.245835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979ee70-d5e8-42ef-b234-bf2e30da20a0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:44.255720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee720dc4ed424e6dbc0543aa47611a78'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:44.256494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee720dc4ed424e6dbc0543aa47611a78'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:44.272954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 888/1753] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:44 2022] PUT /identity/v3/projects/8c8ee0b1420f44d9bc5e666d0fb2f531/users/3b16a0ab91eb4613b564c69aa1e816a9/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:44.277608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff67546-20d0-4472-99bc-0b60ead4d60b None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.278908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff67546-20d0-4472-99bc-0b60ead4d60b None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.280251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff67546-20d0-4472-99bc-0b60ead4d60b None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.291995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 889/1754] 10.222.0.20 () {54 vars in 912 bytes} [Fri Oct 28 19:52:44 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:44.294505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611482-5365-4063-b37a-8a3b89a64158 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.294861 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611482-5365-4063-b37a-8a3b89a64158 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.295257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611482-5365-4063-b37a-8a3b89a64158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.299056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 866/1755] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:43 2022] DELETE /identity/v3/users/ee720dc4ed424e6dbc0543aa47611a78 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:44.310752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:44.313204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.330862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-86611482-5365-4063-b37a-8a3b89a64158 None None] MFA Rules not processed for user `d22234c3873141dfa7445676653e3abd`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:44.332381 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-86611482-5365-4063-b37a-8a3b89a64158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.420025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c3006-a2d8-4c8d-ba5f-e78c1ee0660d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:44.425923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72b1e3-923b-4309-b445-70b4dd23f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:44.428370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72b1e3-923b-4309-b445-70b4dd23f236 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.428370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72b1e3-923b-4309-b445-70b4dd23f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.428370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72b1e3-923b-4309-b445-70b4dd23f236 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.429180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72b1e3-923b-4309-b445-70b4dd23f236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:44.431001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72b1e3-923b-4309-b445-70b4dd23f236 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:44.445145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 890/1756] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:44.446057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 867/1757] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:44.448899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13e1e1-4776-40f8-a504-03746cf570eb None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.449380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13e1e1-4776-40f8-a504-03746cf570eb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.449837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13e1e1-4776-40f8-a504-03746cf570eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.452119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c13f-5f6c-417d-9952-0f16eb58c6dc None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.452462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c13f-5f6c-417d-9952-0f16eb58c6dc None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.452706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c13f-5f6c-417d-9952-0f16eb58c6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.493957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e5d9c13f-5f6c-417d-9952-0f16eb58c6dc None None] MFA Rules not processed for user `3b16a0ab91eb4613b564c69aa1e816a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:44.496042 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e5d9c13f-5f6c-417d-9952-0f16eb58c6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.514346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-df13e1e1-4776-40f8-a504-03746cf570eb None None] MFA Rules not processed for user `444a88451fbd4814b6d81023e68b54a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:44.517172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-df13e1e1-4776-40f8-a504-03746cf570eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.609973 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 868/1758] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:44.612457 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a211793-3b36-4920-87c0-cf90a417d8b5 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.612775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a211793-3b36-4920-87c0-cf90a417d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.613240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a211793-3b36-4920-87c0-cf90a417d8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.624374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 891/1759] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:52:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:44.625896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13e1e1-4776-40f8-a504-03746cf570eb None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:44.641928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-8a211793-3b36-4920-87c0-cf90a417d8b5 None None] MFA Rules not processed for user `444a88451fbd4814b6d81023e68b54a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:44.641928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8a211793-3b36-4920-87c0-cf90a417d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.643563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13e1e1-4776-40f8-a504-03746cf570eb None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:44.648157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 869/1760] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:52:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:44.649202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a211793-3b36-4920-87c0-cf90a417d8b5 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:44.650769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8a211793-3b36-4920-87c0-cf90a417d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.659061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2fd68-2a81-47ee-b5d2-1023a0d8c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:44.659999 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2fd68-2a81-47ee-b5d2-1023a0d8c8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.660271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2fd68-2a81-47ee-b5d2-1023a0d8c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.661435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2fd68-2a81-47ee-b5d2-1023a0d8c8b5 admin admin] PATH_INFO: `/v3/projects/2f42330c479d45c895af9c3af4ba7393/users/b5f5ec11d9be498288f1d628cc72d2ed/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.690113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2fd68-2a81-47ee-b5d2-1023a0d8c8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f42330c479d45c895af9c3af4ba7393, user_id=b5f5ec11d9be498288f1d628cc72d2ed, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:44.697888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2fd68-2a81-47ee-b5d2-1023a0d8c8b5 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:44.722930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 892/1761] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:44 2022] PUT /identity/v3/projects/2f42330c479d45c895af9c3af4ba7393/users/b5f5ec11d9be498288f1d628cc72d2ed/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:44.722930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2fd68-2a81-47ee-b5d2-1023a0d8c8b5 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:44.728296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-23d2fd68-2a81-47ee-b5d2-1023a0d8c8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.775861 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a211793-3b36-4920-87c0-cf90a417d8b5 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:44.845460 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2fd68-2a81-47ee-b5d2-1023a0d8c8b5 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:44.855718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9b486-1a8b-420a-919f-433ab8e54662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:44.856412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9b486-1a8b-420a-919f-433ab8e54662 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.856693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9b486-1a8b-420a-919f-433ab8e54662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.857018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9b486-1a8b-420a-919f-433ab8e54662 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.857731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9b486-1a8b-420a-919f-433ab8e54662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:44.860416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9b486-1a8b-420a-919f-433ab8e54662 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:44.863886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df52181-3a56-4523-a294-2bf5e832f9d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:44.864814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df52181-3a56-4523-a294-2bf5e832f9d0 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.865692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df52181-3a56-4523-a294-2bf5e832f9d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.866038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df52181-3a56-4523-a294-2bf5e832f9d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.906838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 893/1762] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:44 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:44.907826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9b486-1a8b-420a-919f-433ab8e54662 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:44.909662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-52e9b486-1a8b-420a-919f-433ab8e54662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.940915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df52181-3a56-4523-a294-2bf5e832f9d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:44.942598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df52181-3a56-4523-a294-2bf5e832f9d0 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:44.957157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 870/1763] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:44.957927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df52181-3a56-4523-a294-2bf5e832f9d0 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:44.959357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5df52181-3a56-4523-a294-2bf5e832f9d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:44.979434 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9b486-1a8b-420a-919f-433ab8e54662 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:44.983233 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ec12c-4f12-4a9b-98d1-0c30660d0641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:44.983930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ec12c-4f12-4a9b-98d1-0c30660d0641 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:44.984211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ec12c-4f12-4a9b-98d1-0c30660d0641 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:44.984485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ec12c-4f12-4a9b-98d1-0c30660d0641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:44.993593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ec12c-4f12-4a9b-98d1-0c30660d0641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:44.995101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ec12c-4f12-4a9b-98d1-0c30660d0641 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:45.005084 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 894/1764] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:45.006007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ec12c-4f12-4a9b-98d1-0c30660d0641 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:45.060559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df52181-3a56-4523-a294-2bf5e832f9d0 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:45.067495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d34fa-7799-475e-a2d8-c7e7e4aa596d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:45.068178 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d34fa-7799-475e-a2d8-c7e7e4aa596d service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.068456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d34fa-7799-475e-a2d8-c7e7e4aa596d service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.068953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d34fa-7799-475e-a2d8-c7e7e4aa596d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.081969 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d34fa-7799-475e-a2d8-c7e7e4aa596d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:45.083684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d34fa-7799-475e-a2d8-c7e7e4aa596d service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:45.093731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ec12c-4f12-4a9b-98d1-0c30660d0641 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:45.099545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1be77c-bf32-4bf0-abe7-4df61a52d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:45.100467 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1be77c-bf32-4bf0-abe7-4df61a52d33c admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.101043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1be77c-bf32-4bf0-abe7-4df61a52d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.101512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1be77c-bf32-4bf0-abe7-4df61a52d33c admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.102527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 871/1765] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:45.103499 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d34fa-7799-475e-a2d8-c7e7e4aa596d service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:45.106694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-fb1d34fa-7799-475e-a2d8-c7e7e4aa596d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:45.114241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1be77c-bf32-4bf0-abe7-4df61a52d33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:45.116740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1be77c-bf32-4bf0-abe7-4df61a52d33c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:45.130358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d34fa-7799-475e-a2d8-c7e7e4aa596d service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:45.135477 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:45.137368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.137653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.137926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] PATH_INFO: `/v3/projects/07ac76422f2842a298cef8d18e037928` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.139530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ac76422f2842a298cef8d18e037928)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:45.141976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:45.154402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 895/1766] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:45.155852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1be77c-bf32-4bf0-abe7-4df61a52d33c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:45.178355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1be77c-bf32-4bf0-abe7-4df61a52d33c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:45.184612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2544fe8-f8b5-47d4-81a6-0fd116c1a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:45.185437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544fe8-f8b5-47d4-81a6-0fd116c1a588 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.186371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544fe8-f8b5-47d4-81a6-0fd116c1a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.187627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544fe8-f8b5-47d4-81a6-0fd116c1a588 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.188364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2544fe8-f8b5-47d4-81a6-0fd116c1a588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:45.190435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2544fe8-f8b5-47d4-81a6-0fd116c1a588 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:45.221118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ac76422f2842a298cef8d18e037928', 'request_id': 'req-391a5e94-2109-46a1-a4d2-9abdde854f84'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:45.222173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 896/1767] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:45 2022] POST /identity/v3/users => generated 300 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:45.223392 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2544fe8-f8b5-47d4-81a6-0fd116c1a588 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:45.227836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d2544fe8-f8b5-47d4-81a6-0fd116c1a588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:45.238399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ac76422f2842a298cef8d18e037928', 'request_id': 'req-391a5e94-2109-46a1-a4d2-9abdde854f84'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:45.255418 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ac76422f2842a298cef8d18e037928', 'request_id': 'req-391a5e94-2109-46a1-a4d2-9abdde854f84'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:45.276283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] The token cache is being invalidate because project 07ac76422f2842a298cef8d18e037928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:45.277270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:45.278571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:45.284100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 872/1768] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:45 2022] DELETE /identity/v3/projects/07ac76422f2842a298cef8d18e037928 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:45.285233 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:45.287339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:45.366259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2544fe8-f8b5-47d4-81a6-0fd116c1a588 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:45.424599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5e94-2109-46a1-a4d2-9abdde854f84 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:45.431929 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c766d0-0e14-4cc8-8890-474a28c8eba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:45.433092 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c766d0-0e14-4cc8-8890-474a28c8eba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.433810 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c766d0-0e14-4cc8-8890-474a28c8eba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.434479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c766d0-0e14-4cc8-8890-474a28c8eba8 admin admin] PATH_INFO: `/v3/projects/2f42330c479d45c895af9c3af4ba7393/users/b5f5ec11d9be498288f1d628cc72d2ed/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.436812 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c766d0-0e14-4cc8-8890-474a28c8eba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f42330c479d45c895af9c3af4ba7393, user_id=b5f5ec11d9be498288f1d628cc72d2ed, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:45.440150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c766d0-0e14-4cc8-8890-474a28c8eba8 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:45.484596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 873/1769] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:45 2022] PUT /identity/v3/projects/2f42330c479d45c895af9c3af4ba7393/users/b5f5ec11d9be498288f1d628cc72d2ed/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:45.485575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c766d0-0e14-4cc8-8890-474a28c8eba8 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:45.494715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-12c766d0-0e14-4cc8-8890-474a28c8eba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:45.510220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60a522-04e4-4b27-8445-412f38d82922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:45.510898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60a522-04e4-4b27-8445-412f38d82922 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.511180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60a522-04e4-4b27-8445-412f38d82922 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.511451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60a522-04e4-4b27-8445-412f38d82922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.513295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9c60a522-04e4-4b27-8445-412f38d82922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:45.613051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c766d0-0e14-4cc8-8890-474a28c8eba8 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:45.621773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60a522-04e4-4b27-8445-412f38d82922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:45.623975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60a522-04e4-4b27-8445-412f38d82922 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:45.629461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa9b85-9105-4c54-941d-59a46f91a938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:45.630720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa9b85-9105-4c54-941d-59a46f91a938 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.631201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa9b85-9105-4c54-941d-59a46f91a938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.631715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa9b85-9105-4c54-941d-59a46f91a938 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.632771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa9b85-9105-4c54-941d-59a46f91a938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:45.634746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa9b85-9105-4c54-941d-59a46f91a938 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:45.637774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 897/1770] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:45.641103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e7ab-7779-453d-9798-220b406df449 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.641400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e7ab-7779-453d-9798-220b406df449 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.641678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e7ab-7779-453d-9798-220b406df449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.668631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 874/1771] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:45.669701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f041e7ab-7779-453d-9798-220b406df449 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:45.671822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f041e7ab-7779-453d-9798-220b406df449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:45.672509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87141c1-bf68-4149-8e9b-a9808829fd74 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.672861 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87141c1-bf68-4149-8e9b-a9808829fd74 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.673255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87141c1-bf68-4149-8e9b-a9808829fd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.703975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 898/1772] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:45.703975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041e7ab-7779-453d-9798-220b406df449 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:45.703975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f041e7ab-7779-453d-9798-220b406df449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:45.727238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f87141c1-bf68-4149-8e9b-a9808829fd74 None None] MFA Rules not processed for user `b5f5ec11d9be498288f1d628cc72d2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:45.729237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f87141c1-bf68-4149-8e9b-a9808829fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:45.801222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041e7ab-7779-453d-9798-220b406df449 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:45.809007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa84fc-5f09-49b4-bd43-39caf18bd936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:45.809678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa84fc-5f09-49b4-bd43-39caf18bd936 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.809959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa84fc-5f09-49b4-bd43-39caf18bd936 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.810314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa84fc-5f09-49b4-bd43-39caf18bd936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.812244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-11fa84fc-5f09-49b4-bd43-39caf18bd936 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:45.886751 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 875/1773] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:45.890926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa84fc-5f09-49b4-bd43-39caf18bd936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:45.892464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa84fc-5f09-49b4-bd43-39caf18bd936 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:45.894558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87141c1-bf68-4149-8e9b-a9808829fd74 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:45.899229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f87141c1-bf68-4149-8e9b-a9808829fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:45.916548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 899/1774] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:45.916548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa84fc-5f09-49b4-bd43-39caf18bd936 service nova] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:45.944555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa84fc-5f09-49b4-bd43-39caf18bd936 service nova] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:45.950571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9259b7d-1183-4748-b65d-2c56ced017b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:45.951462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259b7d-1183-4748-b65d-2c56ced017b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:45.951901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259b7d-1183-4748-b65d-2c56ced017b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:45.952225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259b7d-1183-4748-b65d-2c56ced017b6 admin admin] PATH_INFO: `/v3/projects/61da13b55ddc4aa6bcdd700f6e21240a/users/ae5b6a58337e4c78868643a4321e2509/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:45.975191 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9259b7d-1183-4748-b65d-2c56ced017b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61da13b55ddc4aa6bcdd700f6e21240a, user_id=ae5b6a58337e4c78868643a4321e2509, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:45.982330 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9259b7d-1183-4748-b65d-2c56ced017b6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:46.001311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 900/1775] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:45 2022] PUT /identity/v3/projects/61da13b55ddc4aa6bcdd700f6e21240a/users/ae5b6a58337e4c78868643a4321e2509/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:46.003023 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d32d-571b-4a4a-a23c-c44c5bcca6e1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:46.003309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d32d-571b-4a4a-a23c-c44c5bcca6e1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:46.006253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d32d-571b-4a4a-a23c-c44c5bcca6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:46.040277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-8010d32d-571b-4a4a-a23c-c44c5bcca6e1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:46.040277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8010d32d-571b-4a4a-a23c-c44c5bcca6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:46.128199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87141c1-bf68-4149-8e9b-a9808829fd74 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:46.205079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 901/1776] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:46.209124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010d32d-571b-4a4a-a23c-c44c5bcca6e1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:46.211936 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8010d32d-571b-4a4a-a23c-c44c5bcca6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:46.238527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4fb61-0ba2-4704-8bf1-3466add0f00a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:46.239899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4fb61-0ba2-4704-8bf1-3466add0f00a service placement] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:46.240659 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4fb61-0ba2-4704-8bf1-3466add0f00a service placement] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:46.240659 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4fb61-0ba2-4704-8bf1-3466add0f00a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:46.244326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3ac4fb61-0ba2-4704-8bf1-3466add0f00a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:46.295099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4fb61-0ba2-4704-8bf1-3466add0f00a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:46.300799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4fb61-0ba2-4704-8bf1-3466add0f00a service placement] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:46.351759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010d32d-571b-4a4a-a23c-c44c5bcca6e1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:46.358025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 876/1777] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:46.362242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4fb61-0ba2-4704-8bf1-3466add0f00a service placement] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:46.365708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3ac4fb61-0ba2-4704-8bf1-3466add0f00a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:46.366715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a94c7-d5d5-47b5-98b9-47d3fdcf9308 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:46.367391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a94c7-d5d5-47b5-98b9-47d3fdcf9308 service placement] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:46.367829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a94c7-d5d5-47b5-98b9-47d3fdcf9308 service placement] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:46.368114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a94c7-d5d5-47b5-98b9-47d3fdcf9308 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:46.390833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a94c7-d5d5-47b5-98b9-47d3fdcf9308 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:46.392390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a94c7-d5d5-47b5-98b9-47d3fdcf9308 service placement] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:46.427915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 902/1778] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:46.428924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a94c7-d5d5-47b5-98b9-47d3fdcf9308 service placement] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:46.468013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a94c7-d5d5-47b5-98b9-47d3fdcf9308 service placement] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:46.483507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647e608-c340-4aa8-aa56-f0fda8c0e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:46.484702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647e608-c340-4aa8-aa56-f0fda8c0e2cc admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:46.487561 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647e608-c340-4aa8-aa56-f0fda8c0e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:46.488803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647e608-c340-4aa8-aa56-f0fda8c0e2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:46.493306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647e608-c340-4aa8-aa56-f0fda8c0e2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:46.501130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647e608-c340-4aa8-aa56-f0fda8c0e2cc admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:46.523943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4fb61-0ba2-4704-8bf1-3466add0f00a service placement] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:46.564933 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 903/1779] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:46.567421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9488bc-2aa2-433a-af5c-4bd9c1d052c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:46.568251 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9488bc-2aa2-433a-af5c-4bd9c1d052c4 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:46.568535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9488bc-2aa2-433a-af5c-4bd9c1d052c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:46.568807 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9488bc-2aa2-433a-af5c-4bd9c1d052c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:46.569147 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abda94-0fbe-4fae-a6d4-ce4633c9b787 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:46.572672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abda94-0fbe-4fae-a6d4-ce4633c9b787 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:46.572975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abda94-0fbe-4fae-a6d4-ce4633c9b787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:46.630360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f1abda94-0fbe-4fae-a6d4-ce4633c9b787 None None] MFA Rules not processed for user `6c853d04dd5147f5961bf551b608da33`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:46.631659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f1abda94-0fbe-4fae-a6d4-ce4633c9b787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:46.690868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9488bc-2aa2-433a-af5c-4bd9c1d052c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:46.694774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9488bc-2aa2-433a-af5c-4bd9c1d052c4 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:46.729588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 877/1780] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:46.739024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9488bc-2aa2-433a-af5c-4bd9c1d052c4 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:46.762825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 904/1781] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:46.764698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abda94-0fbe-4fae-a6d4-ce4633c9b787 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:46.769668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9488bc-2aa2-433a-af5c-4bd9c1d052c4 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:46.774977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f4ed-fec2-4947-a76e-b0669a669e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:46.775636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f4ed-fec2-4947-a76e-b0669a669e36 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:46.776007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f4ed-fec2-4947-a76e-b0669a669e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:46.776284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f4ed-fec2-4947-a76e-b0669a669e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:46.777067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f4ed-fec2-4947-a76e-b0669a669e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:46.777875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f4ed-fec2-4947-a76e-b0669a669e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:46.780088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f4ed-fec2-4947-a76e-b0669a669e36 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:46.819951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 878/1782] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:46.822923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f4ed-fec2-4947-a76e-b0669a669e36 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:46.840203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f4ed-fec2-4947-a76e-b0669a669e36 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:46.841081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abda94-0fbe-4fae-a6d4-ce4633c9b787 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:46.846695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53cf11-b2cb-4f23-9d0a-0b5d7e2b4f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:46.847526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53cf11-b2cb-4f23-9d0a-0b5d7e2b4f40 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:46.847870 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53cf11-b2cb-4f23-9d0a-0b5d7e2b4f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:46.848388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53cf11-b2cb-4f23-9d0a-0b5d7e2b4f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:46.855774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53cf11-b2cb-4f23-9d0a-0b5d7e2b4f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:46.858947 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53cf11-b2cb-4f23-9d0a-0b5d7e2b4f40 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:46.869380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98cc9d-fb7b-4e86-be2b-a8a44f96840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:46.876453 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98cc9d-fb7b-4e86-be2b-a8a44f96840d admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:46.876453 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98cc9d-fb7b-4e86-be2b-a8a44f96840d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:46.876453 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98cc9d-fb7b-4e86-be2b-a8a44f96840d admin admin] PATH_INFO: `/v3/projects/61da13b55ddc4aa6bcdd700f6e21240a/users/ae5b6a58337e4c78868643a4321e2509/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:46.880978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98cc9d-fb7b-4e86-be2b-a8a44f96840d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61da13b55ddc4aa6bcdd700f6e21240a, user_id=ae5b6a58337e4c78868643a4321e2509, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:46.883736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98cc9d-fb7b-4e86-be2b-a8a44f96840d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:46.945838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 905/1783] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:46 2022] PUT /identity/v3/projects/61da13b55ddc4aa6bcdd700f6e21240a/users/ae5b6a58337e4c78868643a4321e2509/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:46.952794 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98cc9d-fb7b-4e86-be2b-a8a44f96840d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:47.005526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 879/1784] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:46 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:47.015134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99e6d-e82f-431c-b975-fae651afb8a0 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:47.015841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99e6d-e82f-431c-b975-fae651afb8a0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:47.026143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99e6d-e82f-431c-b975-fae651afb8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:47.138755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-90c99e6d-e82f-431c-b975-fae651afb8a0 None None] MFA Rules not processed for user `ae5b6a58337e4c78868643a4321e2509`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:47.143880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-90c99e6d-e82f-431c-b975-fae651afb8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:47.154110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98cc9d-fb7b-4e86-be2b-a8a44f96840d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:47.350241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb5545-02ad-4431-add8-e5240c425faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:47.351184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5545-02ad-4431-add8-e5240c425faf service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:47.355840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5545-02ad-4431-add8-e5240c425faf service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:47.356111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5545-02ad-4431-add8-e5240c425faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:47.360703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-86cb5545-02ad-4431-add8-e5240c425faf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:47.486652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 880/1785] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:47.487827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c99e6d-e82f-431c-b975-fae651afb8a0 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:47.586705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb5545-02ad-4431-add8-e5240c425faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:47.587938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb5545-02ad-4431-add8-e5240c425faf service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:47.614742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 906/1786] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:52:47.616274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb5545-02ad-4431-add8-e5240c425faf service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:47.617824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-86cb5545-02ad-4431-add8-e5240c425faf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:47.679226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c99e6d-e82f-431c-b975-fae651afb8a0 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:47.686360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb5545-02ad-4431-add8-e5240c425faf service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:47.695573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ceaff-9cb9-4902-bc2a-e688b2398c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:47.696518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ceaff-9cb9-4902-bc2a-e688b2398c5d admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:47.697208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ceaff-9cb9-4902-bc2a-e688b2398c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:47.697650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ceaff-9cb9-4902-bc2a-e688b2398c5d admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:47.698624 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ceaff-9cb9-4902-bc2a-e688b2398c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:47.706706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858a629-6ac4-48e8-8f81-67845b0a0446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:47.708870 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ceaff-9cb9-4902-bc2a-e688b2398c5d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:47.717132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858a629-6ac4-48e8-8f81-67845b0a0446 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:47.719159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858a629-6ac4-48e8-8f81-67845b0a0446 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:47.720694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858a629-6ac4-48e8-8f81-67845b0a0446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:47.794421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 881/1787] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:47 2022] POST /identity/v3/users => generated 287 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:47.795459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ceaff-9cb9-4902-bc2a-e688b2398c5d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:47.826607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858a629-6ac4-48e8-8f81-67845b0a0446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:47.833578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858a629-6ac4-48e8-8f81-67845b0a0446 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:47.868539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ceaff-9cb9-4902-bc2a-e688b2398c5d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:47.881694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 907/1788] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:47.904734 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616114f-857a-4707-9e31-adf42ee720c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:47.908198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616114f-857a-4707-9e31-adf42ee720c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:47.908702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616114f-857a-4707-9e31-adf42ee720c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:47.913479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616114f-857a-4707-9e31-adf42ee720c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:47.915647 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616114f-857a-4707-9e31-adf42ee720c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:47.917077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616114f-857a-4707-9e31-adf42ee720c3 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:47.944988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858a629-6ac4-48e8-8f81-67845b0a0446 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:47.963627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858a629-6ac4-48e8-8f81-67845b0a0446 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:47.989816 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:47.990759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:47.992009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:47.998022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] PATH_INFO: `/v3/users/3b16a0ab91eb4613b564c69aa1e816a9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:48.004749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b16a0ab91eb4613b564c69aa1e816a9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:48.006917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:48.009861 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 882/1789] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:48.016419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616114f-857a-4707-9e31-adf42ee720c3 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:48.051827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616114f-857a-4707-9e31-adf42ee720c3 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:48.066997 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889192d-c418-4cc3-9122-67ebb80d571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:48.069732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889192d-c418-4cc3-9122-67ebb80d571d admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:48.070026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889192d-c418-4cc3-9122-67ebb80d571d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:48.071642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889192d-c418-4cc3-9122-67ebb80d571d admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:48.075654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889192d-c418-4cc3-9122-67ebb80d571d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:48.085213 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889192d-c418-4cc3-9122-67ebb80d571d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:48.134918 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 883/1790] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:48.140636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889192d-c418-4cc3-9122-67ebb80d571d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:48.181151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889192d-c418-4cc3-9122-67ebb80d571d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:48.193385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340b4c3-b84a-4f97-a09c-9e961f1bfa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:48.194578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340b4c3-b84a-4f97-a09c-9e961f1bfa28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:48.194863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340b4c3-b84a-4f97-a09c-9e961f1bfa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:48.195135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340b4c3-b84a-4f97-a09c-9e961f1bfa28 admin admin] PATH_INFO: `/v3/projects/a8514f9ea30d4ac4a54ba2a8f5d208f3/users/c947871976bb4dc6a7926c161fa44614/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:48.205672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b16a0ab91eb4613b564c69aa1e816a9'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:48.230969 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340b4c3-b84a-4f97-a09c-9e961f1bfa28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8514f9ea30d4ac4a54ba2a8f5d208f3, user_id=c947871976bb4dc6a7926c161fa44614, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:48.237544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340b4c3-b84a-4f97-a09c-9e961f1bfa28 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:48.250451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b16a0ab91eb4613b564c69aa1e816a9'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:48.252896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b16a0ab91eb4613b564c69aa1e816a9'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:48.255438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b16a0ab91eb4613b564c69aa1e816a9'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:48.274544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 884/1791] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:48 2022] PUT /identity/v3/projects/a8514f9ea30d4ac4a54ba2a8f5d208f3/users/c947871976bb4dc6a7926c161fa44614/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:48.292907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d5f24032-1a24-41cb-b6eb-819f436a1246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b16a0ab91eb4613b564c69aa1e816a9'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:48.293246 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c562e6f-9cea-4d8e-badc-0c3e91ef9ccf None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:48.293679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c562e6f-9cea-4d8e-badc-0c3e91ef9ccf None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:48.294163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c562e6f-9cea-4d8e-badc-0c3e91ef9ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:48.336440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 908/1792] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:47 2022] DELETE /identity/v3/users/3b16a0ab91eb4613b564c69aa1e816a9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:48.337397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1154f3e-5708-49d9-8cf6-2f1f09709af1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:48.337681 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1154f3e-5708-49d9-8cf6-2f1f09709af1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:48.338283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1154f3e-5708-49d9-8cf6-2f1f09709af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:48.377024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-4c562e6f-9cea-4d8e-badc-0c3e91ef9ccf None None] MFA Rules not processed for user `c947871976bb4dc6a7926c161fa44614`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:48.380136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4c562e6f-9cea-4d8e-badc-0c3e91ef9ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:48.399280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-e1154f3e-5708-49d9-8cf6-2f1f09709af1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:48.400530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e1154f3e-5708-49d9-8cf6-2f1f09709af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:48.559127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 885/1793] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:48.564684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c562e6f-9cea-4d8e-badc-0c3e91ef9ccf None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:48.567819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4c562e6f-9cea-4d8e-badc-0c3e91ef9ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:48.621093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 909/1794] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:52:48.630908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1154f3e-5708-49d9-8cf6-2f1f09709af1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:48.633262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e1154f3e-5708-49d9-8cf6-2f1f09709af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:48.707032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c562e6f-9cea-4d8e-badc-0c3e91ef9ccf None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:48.719692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01f14-00ad-45db-9105-2af1302d96f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:48.721410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01f14-00ad-45db-9105-2af1302d96f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:48.721696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01f14-00ad-45db-9105-2af1302d96f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:48.721977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01f14-00ad-45db-9105-2af1302d96f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:48.722731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01f14-00ad-45db-9105-2af1302d96f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:48.731472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01f14-00ad-45db-9105-2af1302d96f6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:48.796754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 886/1795] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:48 2022] POST /identity/v3/projects => generated 371 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:48.798743 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01f14-00ad-45db-9105-2af1302d96f6 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:48.845297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1154f3e-5708-49d9-8cf6-2f1f09709af1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:48.979900 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979c4ac-f40e-4172-b4b8-a608295350e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:48.980625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979c4ac-f40e-4172-b4b8-a608295350e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:48.980949 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979c4ac-f40e-4172-b4b8-a608295350e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:48.983002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979c4ac-f40e-4172-b4b8-a608295350e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:49.003510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01f14-00ad-45db-9105-2af1302d96f6 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:49.032911 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba4b0-e897-41ee-897e-53a5fa51ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:49.034809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba4b0-e897-41ee-897e-53a5fa51ea6d admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:49.038438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba4b0-e897-41ee-897e-53a5fa51ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:49.038912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba4b0-e897-41ee-897e-53a5fa51ea6d admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:49.039662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba4b0-e897-41ee-897e-53a5fa51ea6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:49.041670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba4b0-e897-41ee-897e-53a5fa51ea6d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:49.046271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979c4ac-f40e-4172-b4b8-a608295350e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:49.051183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979c4ac-f40e-4172-b4b8-a608295350e8 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:49.113175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 887/1796] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:48 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:49.114692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba4b0-e897-41ee-897e-53a5fa51ea6d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:49.116946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 910/1797] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:52:49.135705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba4b0-e897-41ee-897e-53a5fa51ea6d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:49.145260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b490d-7a64-4e55-8061-a56687c734c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:49.147339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b490d-7a64-4e55-8061-a56687c734c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:49.148290 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b490d-7a64-4e55-8061-a56687c734c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:49.148823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b490d-7a64-4e55-8061-a56687c734c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:49.149829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b490d-7a64-4e55-8061-a56687c734c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:49.151785 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b490d-7a64-4e55-8061-a56687c734c1 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:49.188254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 888/1798] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:49.190476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979c4ac-f40e-4172-b4b8-a608295350e8 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:49.209632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979c4ac-f40e-4172-b4b8-a608295350e8 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:49.217602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcabcb3-b0db-4665-9570-8e58ad8fc653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:49.221776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabcb3-b0db-4665-9570-8e58ad8fc653 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:49.222061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabcb3-b0db-4665-9570-8e58ad8fc653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:49.223668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabcb3-b0db-4665-9570-8e58ad8fc653 admin admin] PATH_INFO: `/v3/projects/404f847afd94449893d9bfbe5f3963fc/users/136bd0b49f3c4a44bffcd1c3dfe88455/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:49.277221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcabcb3-b0db-4665-9570-8e58ad8fc653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404f847afd94449893d9bfbe5f3963fc, user_id=136bd0b49f3c4a44bffcd1c3dfe88455, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:49.289147 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcabcb3-b0db-4665-9570-8e58ad8fc653 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:49.340035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 911/1799] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:49 2022] PUT /identity/v3/projects/404f847afd94449893d9bfbe5f3963fc/users/136bd0b49f3c4a44bffcd1c3dfe88455/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:49.344293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b490d-7a64-4e55-8061-a56687c734c1 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:49.357095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b490d-7a64-4e55-8061-a56687c734c1 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:49.647798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cfe2f-1a76-4ed9-b40f-8380e88a9cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:49.649380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cfe2f-1a76-4ed9-b40f-8380e88a9cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:49.649853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cfe2f-1a76-4ed9-b40f-8380e88a9cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:49.650478 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cfe2f-1a76-4ed9-b40f-8380e88a9cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:49.651611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cfe2f-1a76-4ed9-b40f-8380e88a9cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:49.654568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cfe2f-1a76-4ed9-b40f-8380e88a9cb3 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:49.674731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 889/1800] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:49.678828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcabcb3-b0db-4665-9570-8e58ad8fc653 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:49.701898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcabcb3-b0db-4665-9570-8e58ad8fc653 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:49.713043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e26d5-fd89-4576-a434-b01983b40419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:49.714183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e26d5-fd89-4576-a434-b01983b40419 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:49.714537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e26d5-fd89-4576-a434-b01983b40419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:49.714905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e26d5-fd89-4576-a434-b01983b40419 admin admin] PATH_INFO: `/v3/projects/404f847afd94449893d9bfbe5f3963fc/users/136bd0b49f3c4a44bffcd1c3dfe88455/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:49.717800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e26d5-fd89-4576-a434-b01983b40419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404f847afd94449893d9bfbe5f3963fc, user_id=136bd0b49f3c4a44bffcd1c3dfe88455, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:49.720968 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e26d5-fd89-4576-a434-b01983b40419 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:49.737935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 912/1801] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:49 2022] PUT /identity/v3/projects/404f847afd94449893d9bfbe5f3963fc/users/136bd0b49f3c4a44bffcd1c3dfe88455/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:49.757164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a851d-9276-4e72-8e97-ff41c44e31fe None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:49.757844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a851d-9276-4e72-8e97-ff41c44e31fe None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:49.758288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a851d-9276-4e72-8e97-ff41c44e31fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:49.798126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-bb6a851d-9276-4e72-8e97-ff41c44e31fe None None] MFA Rules not processed for user `136bd0b49f3c4a44bffcd1c3dfe88455`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:49.799896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bb6a851d-9276-4e72-8e97-ff41c44e31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:49.981865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e26d5-fd89-4576-a434-b01983b40419 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:49.984308 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-032e26d5-fd89-4576-a434-b01983b40419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:50.094528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 890/1802] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:52:50.104010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a851d-9276-4e72-8e97-ff41c44e31fe None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:50.105567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bb6a851d-9276-4e72-8e97-ff41c44e31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:50.184948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e26d5-fd89-4576-a434-b01983b40419 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:50.202959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:50.204408 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:50.206411 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:50.209130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] PATH_INFO: `/v3/projects/8c8ee0b1420f44d9bc5e666d0fb2f531` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:50.212301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a851d-9276-4e72-8e97-ff41c44e31fe None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:50.218568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7fe1f-a974-41fb-9000-f24223809a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:50.219558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8ee0b1420f44d9bc5e666d0fb2f531)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:50.220436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7fe1f-a974-41fb-9000-f24223809a42 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:50.220827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7fe1f-a974-41fb-9000-f24223809a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:50.221298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7fe1f-a974-41fb-9000-f24223809a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:50.229043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:50.232626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7fe1f-a974-41fb-9000-f24223809a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:50.234728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7fe1f-a974-41fb-9000-f24223809a42 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:50.264310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 891/1803] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:52:50.427224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8ee0b1420f44d9bc5e666d0fb2f531', 'request_id': 'req-82d1e455-4dc0-46b6-b783-40027ef26a2d'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:50.450042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8ee0b1420f44d9bc5e666d0fb2f531', 'request_id': 'req-82d1e455-4dc0-46b6-b783-40027ef26a2d'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:50.477489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8ee0b1420f44d9bc5e666d0fb2f531', 'request_id': 'req-82d1e455-4dc0-46b6-b783-40027ef26a2d'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:50.495848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] The token cache is being invalidate because project 8c8ee0b1420f44d9bc5e666d0fb2f531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:50.496293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:50.499481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-82d1e455-4dc0-46b6-b783-40027ef26a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:50.502863 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 913/1804] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:49 2022] DELETE /identity/v3/projects/8c8ee0b1420f44d9bc5e666d0fb2f531 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:52:50.506817 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7fe1f-a974-41fb-9000-f24223809a42 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:50.526329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7fe1f-a974-41fb-9000-f24223809a42 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:50.654710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:50.655689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:50.655975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:50.656281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] PATH_INFO: `/v3/users/ae5b6a58337e4c78868643a4321e2509` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:50.658515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5b6a58337e4c78868643a4321e2509)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:50.663035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:50.801588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d19b4-4f4b-4c29-9000-02d443aa9ca2 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:50.801588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d19b4-4f4b-4c29-9000-02d443aa9ca2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:50.801588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d19b4-4f4b-4c29-9000-02d443aa9ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:50.822745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5b6a58337e4c78868643a4321e2509'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:50.828438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-8a9d19b4-4f4b-4c29-9000-02d443aa9ca2 None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:50.829717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8a9d19b4-4f4b-4c29-9000-02d443aa9ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:50.865661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5b6a58337e4c78868643a4321e2509'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:50.866708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5b6a58337e4c78868643a4321e2509'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:50.882869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5b6a58337e4c78868643a4321e2509'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:50.883714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5b6a58337e4c78868643a4321e2509'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:50.925247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 892/1805] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:50 2022] DELETE /identity/v3/users/ae5b6a58337e4c78868643a4321e2509 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:50.978942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 914/1806] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:52:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:52:51.112881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:51.117388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:51.318025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d492c-c153-429c-a166-70ec3e70ec14 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:51.326836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:51.328127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:51.328648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:51.329059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] PATH_INFO: `/v3/users/c947871976bb4dc6a7926c161fa44614` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:51.331509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c947871976bb4dc6a7926c161fa44614)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:51.333510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d19b4-4f4b-4c29-9000-02d443aa9ca2 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:51.334502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:51.335605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8a9d19b4-4f4b-4c29-9000-02d443aa9ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:51.462879 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c947871976bb4dc6a7926c161fa44614'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:51.504421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c947871976bb4dc6a7926c161fa44614'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:51.505932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c947871976bb4dc6a7926c161fa44614'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:51.518007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d19b4-4f4b-4c29-9000-02d443aa9ca2 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:51.544961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c947871976bb4dc6a7926c161fa44614'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:51.547333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3c9c757-86e3-4995-ba76-7c5b67d753ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c947871976bb4dc6a7926c161fa44614'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:51.616657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 893/1807] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:51 2022] DELETE /identity/v3/users/c947871976bb4dc6a7926c161fa44614 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:51.618539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5060e36-40b4-4626-9642-6b65d4e4f217 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:51.619074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5060e36-40b4-4626-9642-6b65d4e4f217 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:51.619496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5060e36-40b4-4626-9642-6b65d4e4f217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:51.650301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d5060e36-40b4-4626-9642-6b65d4e4f217 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:51.651974 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d5060e36-40b4-4626-9642-6b65d4e4f217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:51.723077 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419c7d-ffa0-45dd-8a19-38d3a63ec787 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:51.723776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419c7d-ffa0-45dd-8a19-38d3a63ec787 service swift] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:51.724058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419c7d-ffa0-45dd-8a19-38d3a63ec787 service swift] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:51.724335 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419c7d-ffa0-45dd-8a19-38d3a63ec787 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:51.740288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f4419c7d-ffa0-45dd-8a19-38d3a63ec787 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:51.768345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 894/1808] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:51.769622 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5060e36-40b4-4626-9642-6b65d4e4f217 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:51.771886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d5060e36-40b4-4626-9642-6b65d4e4f217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:51.795860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5060e36-40b4-4626-9642-6b65d4e4f217 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:51.806256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:51.808188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:51.808557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:51.808951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] PATH_INFO: `/v3/users/de5588548b8d424886556677ef3831db` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:51.813755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5588548b8d424886556677ef3831db)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:51.816249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:51.879041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4419c7d-ffa0-45dd-8a19-38d3a63ec787 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:51.880682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4419c7d-ffa0-45dd-8a19-38d3a63ec787 service swift] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:51.901193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 915/1809] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:52:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:52:51.902226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419c7d-ffa0-45dd-8a19-38d3a63ec787 service swift] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:51.904944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5588548b8d424886556677ef3831db'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:51.906011 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f4419c7d-ffa0-45dd-8a19-38d3a63ec787 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:51.938460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5588548b8d424886556677ef3831db'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:51.940391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5588548b8d424886556677ef3831db'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:51.959994 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5588548b8d424886556677ef3831db'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:51.961184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b9d452ec-8a2e-4945-815a-821f860c0196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5588548b8d424886556677ef3831db'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:51.989223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 895/1810] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:51 2022] DELETE /identity/v3/users/de5588548b8d424886556677ef3831db => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:51.992314 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa0584-bb32-4b1f-a0c5-1f806ccba13c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:51.992547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa0584-bb32-4b1f-a0c5-1f806ccba13c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:51.992823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa0584-bb32-4b1f-a0c5-1f806ccba13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:52.020149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-33fa0584-bb32-4b1f-a0c5-1f806ccba13c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:52.022380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-33fa0584-bb32-4b1f-a0c5-1f806ccba13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:52.048638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419c7d-ffa0-45dd-8a19-38d3a63ec787 service swift] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:52.167960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 896/1811] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:52.180098 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d9a7f-583f-4824-9a1a-3268610a9585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:52.181291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d9a7f-583f-4824-9a1a-3268610a9585 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:52.181291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d9a7f-583f-4824-9a1a-3268610a9585 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:52.181635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d9a7f-583f-4824-9a1a-3268610a9585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:52.188940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7e6d9a7f-583f-4824-9a1a-3268610a9585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:52.231317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa0584-bb32-4b1f-a0c5-1f806ccba13c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:52.232555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d9a7f-583f-4824-9a1a-3268610a9585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:52.234261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d9a7f-583f-4824-9a1a-3268610a9585 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:52.234467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-33fa0584-bb32-4b1f-a0c5-1f806ccba13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:52.262600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa0584-bb32-4b1f-a0c5-1f806ccba13c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:52.268482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 916/1812] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:52.272689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d2bb3-7474-49e3-b44b-ef024c367edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:52.273381 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d2bb3-7474-49e3-b44b-ef024c367edf service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:52.274645 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d2bb3-7474-49e3-b44b-ef024c367edf service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:52.274939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d2bb3-7474-49e3-b44b-ef024c367edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:52.304388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d2bb3-7474-49e3-b44b-ef024c367edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:52.313896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d2bb3-7474-49e3-b44b-ef024c367edf service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:52.341518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 897/1813] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:53.254247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d9a7f-583f-4824-9a1a-3268610a9585 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:53.256173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7e6d9a7f-583f-4824-9a1a-3268610a9585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:53.311369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d9a7f-583f-4824-9a1a-3268610a9585 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:53.346967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:53.363207 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:53.363507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:53.365943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] PATH_INFO: `/v3/projects/61da13b55ddc4aa6bcdd700f6e21240a` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:53.380604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61da13b55ddc4aa6bcdd700f6e21240a)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:53.382674 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:53.484402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61da13b55ddc4aa6bcdd700f6e21240a', 'request_id': 'req-282667b8-8a9e-4a53-86a1-93ad8413bd74'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:53.502540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61da13b55ddc4aa6bcdd700f6e21240a', 'request_id': 'req-282667b8-8a9e-4a53-86a1-93ad8413bd74'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:53.517751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61da13b55ddc4aa6bcdd700f6e21240a', 'request_id': 'req-282667b8-8a9e-4a53-86a1-93ad8413bd74'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:53.551487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] The token cache is being invalidate because project 61da13b55ddc4aa6bcdd700f6e21240a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:53.551822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:53.552732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-282667b8-8a9e-4a53-86a1-93ad8413bd74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:53.563380 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 917/1814] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:53 2022] DELETE /identity/v3/projects/61da13b55ddc4aa6bcdd700f6e21240a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:53.567655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376a33-71f6-48ea-a407-8030bcf9e5f8 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:53.568124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376a33-71f6-48ea-a407-8030bcf9e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:53.568394 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376a33-71f6-48ea-a407-8030bcf9e5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:53.612773 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-58376a33-71f6-48ea-a407-8030bcf9e5f8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:53.614289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-58376a33-71f6-48ea-a407-8030bcf9e5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:53.884943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 898/1815] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:53.893013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f75a8-7e56-4e3a-8a47-e5889a8f2ae9 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:53.893461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f75a8-7e56-4e3a-8a47-e5889a8f2ae9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:53.893904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f75a8-7e56-4e3a-8a47-e5889a8f2ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:53.944925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fb5f75a8-7e56-4e3a-8a47-e5889a8f2ae9 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:53.948990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fb5f75a8-7e56-4e3a-8a47-e5889a8f2ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:53.967207 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 918/1816] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:53.970848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376a33-71f6-48ea-a407-8030bcf9e5f8 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:53.990016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376a33-71f6-48ea-a407-8030bcf9e5f8 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:54.036991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e4db7-88e1-41cd-b470-c2a59a972590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:54.039473 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e4db7-88e1-41cd-b470-c2a59a972590 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:54.039785 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e4db7-88e1-41cd-b470-c2a59a972590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:54.040069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e4db7-88e1-41cd-b470-c2a59a972590 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:54.040838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e4db7-88e1-41cd-b470-c2a59a972590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:54.041153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e4db7-88e1-41cd-b470-c2a59a972590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:54.057671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e4db7-88e1-41cd-b470-c2a59a972590 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:54.103551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 899/1817] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:54.108261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f75a8-7e56-4e3a-8a47-e5889a8f2ae9 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:54.132821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f75a8-7e56-4e3a-8a47-e5889a8f2ae9 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:54.141318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db17c4-b7a0-422a-8848-4438e21b2193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:54.149024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db17c4-b7a0-422a-8848-4438e21b2193 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:54.149024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db17c4-b7a0-422a-8848-4438e21b2193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:54.149024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db17c4-b7a0-422a-8848-4438e21b2193 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:54.149024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db17c4-b7a0-422a-8848-4438e21b2193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:54.149024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db17c4-b7a0-422a-8848-4438e21b2193 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:54.221039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 919/1818] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:54 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:54.222291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e4db7-88e1-41cd-b470-c2a59a972590 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:54.235159 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e4db7-88e1-41cd-b470-c2a59a972590 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:54.399288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a397d-81ac-403b-a1b0-d23b3b3db1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:54.400080 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a397d-81ac-403b-a1b0-d23b3b3db1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:54.400320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a397d-81ac-403b-a1b0-d23b3b3db1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:54.400602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a397d-81ac-403b-a1b0-d23b3b3db1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:54.401322 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a397d-81ac-403b-a1b0-d23b3b3db1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:54.403329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a397d-81ac-403b-a1b0-d23b3b3db1f5 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:54.439927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 900/1819] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:54 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:52:54.444490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db17c4-b7a0-422a-8848-4438e21b2193 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:54.461538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db17c4-b7a0-422a-8848-4438e21b2193 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:54.472701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552a591-385c-454f-a399-6b2961db41d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:54.473509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a591-385c-454f-a399-6b2961db41d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:54.473997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a591-385c-454f-a399-6b2961db41d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:54.474505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a591-385c-454f-a399-6b2961db41d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:54.475540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552a591-385c-454f-a399-6b2961db41d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:54.477416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552a591-385c-454f-a399-6b2961db41d1 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:54.491162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 920/1820] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:54.495038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a397d-81ac-403b-a1b0-d23b3b3db1f5 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:54.510742 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a397d-81ac-403b-a1b0-d23b3b3db1f5 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:54.519222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1dae9b-7724-47b8-8038-81d68a412760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:54.520754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dae9b-7724-47b8-8038-81d68a412760 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:54.521532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dae9b-7724-47b8-8038-81d68a412760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:54.522405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dae9b-7724-47b8-8038-81d68a412760 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:54.524376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1dae9b-7724-47b8-8038-81d68a412760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:54.527304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1dae9b-7724-47b8-8038-81d68a412760 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:54.544523 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 901/1821] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:52:54.548785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552a591-385c-454f-a399-6b2961db41d1 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:54.564587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552a591-385c-454f-a399-6b2961db41d1 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:54.574266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fbd01-c1e4-4656-bf5c-fd01fe1baf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:54.577930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fbd01-c1e4-4656-bf5c-fd01fe1baf6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:54.578730 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fbd01-c1e4-4656-bf5c-fd01fe1baf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:54.579043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fbd01-c1e4-4656-bf5c-fd01fe1baf6b admin admin] PATH_INFO: `/v3/projects/1e66153339144990b2f1e154d5ee7f50/users/23339b37c7b946449eb5e06a0504b0f9/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:54.611611 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fbd01-c1e4-4656-bf5c-fd01fe1baf6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e66153339144990b2f1e154d5ee7f50, user_id=23339b37c7b946449eb5e06a0504b0f9, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:54.616384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fbd01-c1e4-4656-bf5c-fd01fe1baf6b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:54.650403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 921/1822] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:54 2022] PUT /identity/v3/projects/1e66153339144990b2f1e154d5ee7f50/users/23339b37c7b946449eb5e06a0504b0f9/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:54.657864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9537615-efb2-4608-94e5-7af8a9443cfc None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:54.658510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9537615-efb2-4608-94e5-7af8a9443cfc None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:54.661532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9537615-efb2-4608-94e5-7af8a9443cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:54.663934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fbd01-c1e4-4656-bf5c-fd01fe1baf6b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:54.671013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0d4fbd01-c1e4-4656-bf5c-fd01fe1baf6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:54.734766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d9537615-efb2-4608-94e5-7af8a9443cfc None None] MFA Rules not processed for user `23339b37c7b946449eb5e06a0504b0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:54.737819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d9537615-efb2-4608-94e5-7af8a9443cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:54.837746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fbd01-c1e4-4656-bf5c-fd01fe1baf6b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:54.850655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:54.851558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:54.851778 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 902/1823] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:54.852071 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:54.852472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] PATH_INFO: `/v3/projects/a8514f9ea30d4ac4a54ba2a8f5d208f3` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:54.852843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9537615-efb2-4608-94e5-7af8a9443cfc None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:54.855271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8514f9ea30d4ac4a54ba2a8f5d208f3)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:54.858700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d9537615-efb2-4608-94e5-7af8a9443cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:54.861118 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:54.878386 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9537615-efb2-4608-94e5-7af8a9443cfc None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:54.891545 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:54.893063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:54.893063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:54.893675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] PATH_INFO: `/v3/projects/9ce655afe7fb45b2b70ebcad9360343d` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:54.895374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce655afe7fb45b2b70ebcad9360343d)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:54.897466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:54.957979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8514f9ea30d4ac4a54ba2a8f5d208f3', 'request_id': 'req-b6641384-0e2e-4560-aa6f-a76f79caf99f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:54.968873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8514f9ea30d4ac4a54ba2a8f5d208f3', 'request_id': 'req-b6641384-0e2e-4560-aa6f-a76f79caf99f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:54.980623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8514f9ea30d4ac4a54ba2a8f5d208f3', 'request_id': 'req-b6641384-0e2e-4560-aa6f-a76f79caf99f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:54.992193 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce655afe7fb45b2b70ebcad9360343d', 'request_id': 'req-c319ea3d-7ec5-49f6-9624-1dc819c2baca'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:54.994101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] The token cache is being invalidate because project a8514f9ea30d4ac4a54ba2a8f5d208f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:54.994693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:54.995729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:54.998227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 922/1824] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:54 2022] DELETE /identity/v3/projects/a8514f9ea30d4ac4a54ba2a8f5d208f3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:54.999105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:55.002770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:55.010172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce655afe7fb45b2b70ebcad9360343d', 'request_id': 'req-c319ea3d-7ec5-49f6-9624-1dc819c2baca'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.023344 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce655afe7fb45b2b70ebcad9360343d', 'request_id': 'req-c319ea3d-7ec5-49f6-9624-1dc819c2baca'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.052723 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] The token cache is being invalidate because project 9ce655afe7fb45b2b70ebcad9360343d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:55.053075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.054453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.057059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 903/1825] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:54 2022] DELETE /identity/v3/projects/9ce655afe7fb45b2b70ebcad9360343d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:55.057791 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:55.065552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:55.184286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6641384-0e2e-4560-aa6f-a76f79caf99f admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:55.247834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319ea3d-7ec5-49f6-9624-1dc819c2baca admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:55.254416 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:55.256298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:55.256915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:55.257621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] PATH_INFO: `/v3/users/136bd0b49f3c4a44bffcd1c3dfe88455` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:55.259888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136bd0b49f3c4a44bffcd1c3dfe88455)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:55.263148 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:55.316261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8bd5b-c702-4874-8d14-0d30d50970c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:55.317658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8bd5b-c702-4874-8d14-0d30d50970c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:55.318967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8bd5b-c702-4874-8d14-0d30d50970c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:55.320630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8bd5b-c702-4874-8d14-0d30d50970c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:55.322038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8bd5b-c702-4874-8d14-0d30d50970c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:55.325659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8bd5b-c702-4874-8d14-0d30d50970c1 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:55.432169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 923/1826] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:54 2022] POST /identity/v3/projects => generated 387 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:55.432169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8bd5b-c702-4874-8d14-0d30d50970c1 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:55.436161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-93f8bd5b-c702-4874-8d14-0d30d50970c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:55.475677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136bd0b49f3c4a44bffcd1c3dfe88455'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.515771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136bd0b49f3c4a44bffcd1c3dfe88455'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.518030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136bd0b49f3c4a44bffcd1c3dfe88455'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.555322 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136bd0b49f3c4a44bffcd1c3dfe88455'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.556953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136bd0b49f3c4a44bffcd1c3dfe88455'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.588349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 904/1827] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:55 2022] DELETE /identity/v3/users/136bd0b49f3c4a44bffcd1c3dfe88455 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:55.589172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:55.592276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:55.606469 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8bd5b-c702-4874-8d14-0d30d50970c1 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:55.731357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4bf3f-3267-4c8f-85a2-ec00e5ddcb93 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:55.736956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b68e0-3c7e-462b-b068-a256ce96a7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:55.737661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b68e0-3c7e-462b-b068-a256ce96a7cd admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:55.737938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b68e0-3c7e-462b-b068-a256ce96a7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:55.738273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b68e0-3c7e-462b-b068-a256ce96a7cd admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:55.739083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b68e0-3c7e-462b-b068-a256ce96a7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:55.741820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b68e0-3c7e-462b-b068-a256ce96a7cd admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:55.765915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:55.767872 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:55.768151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:55.769336 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] PATH_INFO: `/v3/users/d22234c3873141dfa7445676653e3abd` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:55.772472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22234c3873141dfa7445676653e3abd)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:55.775946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:55.781249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 905/1828] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:55 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:55.783119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b32be-3e7a-459d-843f-3805063ff32f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:55.783406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b32be-3e7a-459d-843f-3805063ff32f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:55.784430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b32be-3e7a-459d-843f-3805063ff32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:55.830214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-7d6b32be-3e7a-459d-843f-3805063ff32f None None] MFA Rules not processed for user `444a88451fbd4814b6d81023e68b54a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:55.831582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7d6b32be-3e7a-459d-843f-3805063ff32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:55.933806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22234c3873141dfa7445676653e3abd'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.963638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22234c3873141dfa7445676653e3abd'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.965675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22234c3873141dfa7445676653e3abd'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.967935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22234c3873141dfa7445676653e3abd'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:55.971849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 906/1829] 10.222.0.55 () {58 vars in 1015 bytes} [Fri Oct 28 19:52:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:55.973133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b32be-3e7a-459d-843f-3805063ff32f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:55.983617 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22234c3873141dfa7445676653e3abd'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:56.023936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b32be-3e7a-459d-843f-3805063ff32f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:56.038151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 924/1830] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:55 2022] DELETE /identity/v3/users/d22234c3873141dfa7445676653e3abd => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:56.043923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:56.046423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13571d3f-65eb-49e3-8748-fe8360574b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:56.047154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13571d3f-65eb-49e3-8748-fe8360574b20 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:56.047429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13571d3f-65eb-49e3-8748-fe8360574b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:56.047700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13571d3f-65eb-49e3-8748-fe8360574b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:56.048494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13571d3f-65eb-49e3-8748-fe8360574b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:56.050282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13571d3f-65eb-49e3-8748-fe8360574b20 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:56.065438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:56.082612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 907/1831] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:56.083630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13571d3f-65eb-49e3-8748-fe8360574b20 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:56.087192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-13571d3f-65eb-49e3-8748-fe8360574b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:56.139811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13571d3f-65eb-49e3-8748-fe8360574b20 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:56.222677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5352-a410-476f-9cb4-eda388f46934 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:56.231056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e0d3-aeed-4e21-99a8-cb112dec461f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:56.231732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e0d3-aeed-4e21-99a8-cb112dec461f service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:56.232013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e0d3-aeed-4e21-99a8-cb112dec461f service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:56.232347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e0d3-aeed-4e21-99a8-cb112dec461f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:56.240861 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4a54e0d3-aeed-4e21-99a8-cb112dec461f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:56.258658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e0d3-aeed-4e21-99a8-cb112dec461f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:56.261851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e0d3-aeed-4e21-99a8-cb112dec461f service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:56.268050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83e36-b3a5-4962-873c-00db5177bd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:56.268784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83e36-b3a5-4962-873c-00db5177bd65 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:56.269061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83e36-b3a5-4962-873c-00db5177bd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:56.269460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83e36-b3a5-4962-873c-00db5177bd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:56.283490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 925/1832] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:56.284662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e0d3-aeed-4e21-99a8-cb112dec461f service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:56.286580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83e36-b3a5-4962-873c-00db5177bd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:56.288411 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83e36-b3a5-4962-873c-00db5177bd65 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:56.291470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4a54e0d3-aeed-4e21-99a8-cb112dec461f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:56.314003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e0d3-aeed-4e21-99a8-cb112dec461f service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:56.315492 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 908/1833] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:56.315737 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83e36-b3a5-4962-873c-00db5177bd65 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:56.325551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb700d8-5fcd-431f-a665-2076d6eb444a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:56.326337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb700d8-5fcd-431f-a665-2076d6eb444a service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:56.326644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb700d8-5fcd-431f-a665-2076d6eb444a service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:56.326884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb700d8-5fcd-431f-a665-2076d6eb444a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:56.336298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83e36-b3a5-4962-873c-00db5177bd65 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:56.344461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00032880-7ade-406a-afa3-ab297f241527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:56.345443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00032880-7ade-406a-afa3-ab297f241527 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:56.345774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00032880-7ade-406a-afa3-ab297f241527 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:56.345979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00032880-7ade-406a-afa3-ab297f241527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:56.352355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb700d8-5fcd-431f-a665-2076d6eb444a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:56.354365 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb700d8-5fcd-431f-a665-2076d6eb444a service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:56.368973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 926/1834] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:56.370061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00032880-7ade-406a-afa3-ab297f241527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:56.371639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00032880-7ade-406a-afa3-ab297f241527 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:56.373515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb700d8-5fcd-431f-a665-2076d6eb444a service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:56.379163 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fdb700d8-5fcd-431f-a665-2076d6eb444a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:56.390464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 909/1835] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:56.426053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00032880-7ade-406a-afa3-ab297f241527 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:56.428575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-00032880-7ade-406a-afa3-ab297f241527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:56.660608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb700d8-5fcd-431f-a665-2076d6eb444a service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:56.693413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305615e4-15d1-4dc3-a63d-50818e679a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:56.697273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305615e4-15d1-4dc3-a63d-50818e679a7e admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:56.699855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305615e4-15d1-4dc3-a63d-50818e679a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:56.700690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305615e4-15d1-4dc3-a63d-50818e679a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:56.703120 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305615e4-15d1-4dc3-a63d-50818e679a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:56.718015 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305615e4-15d1-4dc3-a63d-50818e679a7e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:56.725199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00032880-7ade-406a-afa3-ab297f241527 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:56.762549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:56.770300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:56.771684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:56.772104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] PATH_INFO: `/v3/projects/404f847afd94449893d9bfbe5f3963fc` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:56.773765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=404f847afd94449893d9bfbe5f3963fc)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:56.776019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:56.778343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 927/1836] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:56.784136 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305615e4-15d1-4dc3-a63d-50818e679a7e admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:56.825847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305615e4-15d1-4dc3-a63d-50818e679a7e admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:56.834439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72321c-aefc-4078-b215-0955422b4c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:56.836560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72321c-aefc-4078-b215-0955422b4c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:56.836945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72321c-aefc-4078-b215-0955422b4c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:56.837359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72321c-aefc-4078-b215-0955422b4c16 admin admin] PATH_INFO: `/v3/projects/389c5e4b18684a629416e50310c7a86b/users/9946c7d583034b72a05eeebd0b493b70/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:56.866912 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72321c-aefc-4078-b215-0955422b4c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389c5e4b18684a629416e50310c7a86b, user_id=9946c7d583034b72a05eeebd0b493b70, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:56.868732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404f847afd94449893d9bfbe5f3963fc', 'request_id': 'req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:56.872234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72321c-aefc-4078-b215-0955422b4c16 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:56.886844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404f847afd94449893d9bfbe5f3963fc', 'request_id': 'req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:56.900830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 928/1837] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:56 2022] PUT /identity/v3/projects/389c5e4b18684a629416e50310c7a86b/users/9946c7d583034b72a05eeebd0b493b70/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:56.911131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404f847afd94449893d9bfbe5f3963fc', 'request_id': 'req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:56.921706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32c6f-ec1a-4aa8-bc08-7cb533cab005 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:56.922016 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32c6f-ec1a-4aa8-bc08-7cb533cab005 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:56.923352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32c6f-ec1a-4aa8-bc08-7cb533cab005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:56.925277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] The token cache is being invalidate because project 404f847afd94449893d9bfbe5f3963fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:56.925571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:56.936977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3152cc8d-fbbc-411a-ad30-0f91752a9ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:56.940518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 910/1838] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:56 2022] DELETE /identity/v3/projects/404f847afd94449893d9bfbe5f3963fc => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:52:56.945845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6e9a4-bcce-49b0-95b0-77ee71b9547f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:56.950705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6e9a4-bcce-49b0-95b0-77ee71b9547f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:56.951030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6e9a4-bcce-49b0-95b0-77ee71b9547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:56.981693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-62c6e9a4-bcce-49b0-95b0-77ee71b9547f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:56.984048 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-62c6e9a4-bcce-49b0-95b0-77ee71b9547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:57.027645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-16f32c6f-ec1a-4aa8-bc08-7cb533cab005 None None] MFA Rules not processed for user `9946c7d583034b72a05eeebd0b493b70`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:57.033563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-16f32c6f-ec1a-4aa8-bc08-7cb533cab005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:57.094426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 911/1839] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:57.096331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d5bf-e830-48b5-9f0d-b70b162a9565 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.096794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d5bf-e830-48b5-9f0d-b70b162a9565 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.097251 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d5bf-e830-48b5-9f0d-b70b162a9565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.121124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-df16d5bf-e830-48b5-9f0d-b70b162a9565 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:57.122741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-df16d5bf-e830-48b5-9f0d-b70b162a9565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:57.136496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 912/1840] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:57.138509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d5bf-e830-48b5-9f0d-b70b162a9565 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.151655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d5bf-e830-48b5-9f0d-b70b162a9565 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.158766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3d98-3d57-43ea-95bd-146f3d1599a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.159753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3d98-3d57-43ea-95bd-146f3d1599a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.161354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3d98-3d57-43ea-95bd-146f3d1599a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.161804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3d98-3d57-43ea-95bd-146f3d1599a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.162776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3d98-3d57-43ea-95bd-146f3d1599a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:57.163287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3d98-3d57-43ea-95bd-146f3d1599a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.165719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3d98-3d57-43ea-95bd-146f3d1599a6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:57.187383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 929/1841] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:57.188539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 913/1842] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:52:57.189382 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32c6f-ec1a-4aa8-bc08-7cb533cab005 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.190731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3d98-3d57-43ea-95bd-146f3d1599a6 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.192940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-34cb3d98-3d57-43ea-95bd-146f3d1599a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:57.211255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3d98-3d57-43ea-95bd-146f3d1599a6 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.217715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22133b-7536-4942-9aee-092be40189ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.218728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22133b-7536-4942-9aee-092be40189ff admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.219616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22133b-7536-4942-9aee-092be40189ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.220197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22133b-7536-4942-9aee-092be40189ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.221354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22133b-7536-4942-9aee-092be40189ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.224389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22133b-7536-4942-9aee-092be40189ff admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:57.230809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32c6f-ec1a-4aa8-bc08-7cb533cab005 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.237575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72d035-dd66-4b3f-b50b-621e00537d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.239407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72d035-dd66-4b3f-b50b-621e00537d75 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.239958 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72d035-dd66-4b3f-b50b-621e00537d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.240330 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72d035-dd66-4b3f-b50b-621e00537d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.241149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72d035-dd66-4b3f-b50b-621e00537d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.243241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72d035-dd66-4b3f-b50b-621e00537d75 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:57.276737 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 914/1843] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:57 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:52:57.287268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22133b-7536-4942-9aee-092be40189ff admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.335149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 930/1844] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:57 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:52:57.339887 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72d035-dd66-4b3f-b50b-621e00537d75 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.457410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22133b-7536-4942-9aee-092be40189ff admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.459826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72d035-dd66-4b3f-b50b-621e00537d75 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.468591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b72d0e-f6be-44e4-a2f4-c263ecedb11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.469840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b72d0e-f6be-44e4-a2f4-c263ecedb11a admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.470349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b72d0e-f6be-44e4-a2f4-c263ecedb11a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.470766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b72d0e-f6be-44e4-a2f4-c263ecedb11a admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.471874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b72d0e-f6be-44e4-a2f4-c263ecedb11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.472317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f79ec-58cc-4e46-96f3-5fd822edbb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.473077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f79ec-58cc-4e46-96f3-5fd822edbb46 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.473427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f79ec-58cc-4e46-96f3-5fd822edbb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.473768 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f79ec-58cc-4e46-96f3-5fd822edbb46 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.474671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f79ec-58cc-4e46-96f3-5fd822edbb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.475128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b72d0e-f6be-44e4-a2f4-c263ecedb11a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:57.476743 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f79ec-58cc-4e46-96f3-5fd822edbb46 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:57.521433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 931/1845] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:57 2022] POST /identity/v3/users => generated 282 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:52:57.523109 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 915/1846] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:57 2022] POST /identity/v3/users => generated 300 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:52:57.527299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b72d0e-f6be-44e4-a2f4-c263ecedb11a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.528708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f79ec-58cc-4e46-96f3-5fd822edbb46 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.543667 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b72d0e-f6be-44e4-a2f4-c263ecedb11a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.549401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f79ec-58cc-4e46-96f3-5fd822edbb46 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.560851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619a2a2-8c51-4ed3-837f-91cfe37ed643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.562144 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619a2a2-8c51-4ed3-837f-91cfe37ed643 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.562884 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451170-91f3-4694-81f6-e51127a0c567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.563666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451170-91f3-4694-81f6-e51127a0c567 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.564070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451170-91f3-4694-81f6-e51127a0c567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.564455 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451170-91f3-4694-81f6-e51127a0c567 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.564721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619a2a2-8c51-4ed3-837f-91cfe37ed643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.565342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9451170-91f3-4694-81f6-e51127a0c567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.567055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619a2a2-8c51-4ed3-837f-91cfe37ed643 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.567180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9451170-91f3-4694-81f6-e51127a0c567 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:57.570069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619a2a2-8c51-4ed3-837f-91cfe37ed643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.575510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619a2a2-8c51-4ed3-837f-91cfe37ed643 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:57.600011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 916/1847] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:57.608617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451170-91f3-4694-81f6-e51127a0c567 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.617671 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 932/1848] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:57.626585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619a2a2-8c51-4ed3-837f-91cfe37ed643 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.641657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451170-91f3-4694-81f6-e51127a0c567 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.666454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619a2a2-8c51-4ed3-837f-91cfe37ed643 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.670374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4360b9-a07b-40c2-9ddc-cf4028d8060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.671347 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4360b9-a07b-40c2-9ddc-cf4028d8060d admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.671631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4360b9-a07b-40c2-9ddc-cf4028d8060d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.671914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4360b9-a07b-40c2-9ddc-cf4028d8060d admin admin] PATH_INFO: `/v3/projects/46b4817c20d84ee892f02d2807236842/users/f2d539c6f0f442b796a4c779d51100a6/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.691306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a999bc-dfa0-44c2-a148-79a9b6c05ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.692001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a999bc-dfa0-44c2-a148-79a9b6c05ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.692284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a999bc-dfa0-44c2-a148-79a9b6c05ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.693205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a999bc-dfa0-44c2-a148-79a9b6c05ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.694109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a999bc-dfa0-44c2-a148-79a9b6c05ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.696044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a999bc-dfa0-44c2-a148-79a9b6c05ef6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:57.726317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4360b9-a07b-40c2-9ddc-cf4028d8060d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b4817c20d84ee892f02d2807236842, user_id=f2d539c6f0f442b796a4c779d51100a6, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.729015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4360b9-a07b-40c2-9ddc-cf4028d8060d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:57.729924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 933/1849] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:57.735595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a999bc-dfa0-44c2-a148-79a9b6c05ef6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.769917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 917/1850] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:57 2022] PUT /identity/v3/projects/46b4817c20d84ee892f02d2807236842/users/f2d539c6f0f442b796a4c779d51100a6/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:57.771613 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4360b9-a07b-40c2-9ddc-cf4028d8060d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:57.776201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a999bc-dfa0-44c2-a148-79a9b6c05ef6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.911820 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c11f2-99a9-4176-9b76-5e41a2e2b9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.914734 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c11f2-99a9-4176-9b76-5e41a2e2b9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.915747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c11f2-99a9-4176-9b76-5e41a2e2b9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.916986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c11f2-99a9-4176-9b76-5e41a2e2b9e4 admin admin] PATH_INFO: `/v3/projects/0b28723a94874c4483bfad112e9ac02d/users/7460d01353bc41c99b9cbf863f8cf327/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.957315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4360b9-a07b-40c2-9ddc-cf4028d8060d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:57.975668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab10bf5-4a4a-466b-bcb5-7f2c8e297928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:57.976688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab10bf5-4a4a-466b-bcb5-7f2c8e297928 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:57.977123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab10bf5-4a4a-466b-bcb5-7f2c8e297928 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:57.977881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab10bf5-4a4a-466b-bcb5-7f2c8e297928 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:57.979319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab10bf5-4a4a-466b-bcb5-7f2c8e297928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.986517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c11f2-99a9-4176-9b76-5e41a2e2b9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b28723a94874c4483bfad112e9ac02d, user_id=7460d01353bc41c99b9cbf863f8cf327, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:57.991530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab10bf5-4a4a-466b-bcb5-7f2c8e297928 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:58.002068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c11f2-99a9-4176-9b76-5e41a2e2b9e4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:58.034858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 918/1851] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:58.039114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab10bf5-4a4a-466b-bcb5-7f2c8e297928 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:58.046560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 934/1852] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:57 2022] PUT /identity/v3/projects/0b28723a94874c4483bfad112e9ac02d/users/7460d01353bc41c99b9cbf863f8cf327/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:52:58.057998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925d7bd-4f46-461a-8aed-ef56478a8a1c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:58.058314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925d7bd-4f46-461a-8aed-ef56478a8a1c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:58.058587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925d7bd-4f46-461a-8aed-ef56478a8a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:58.064654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab10bf5-4a4a-466b-bcb5-7f2c8e297928 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:58.127168 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4925d7bd-4f46-461a-8aed-ef56478a8a1c None None] MFA Rules not processed for user `7460d01353bc41c99b9cbf863f8cf327`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:58.128402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4925d7bd-4f46-461a-8aed-ef56478a8a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:58.235255 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 935/1853] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:58.241758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925d7bd-4f46-461a-8aed-ef56478a8a1c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:58.283837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23c6c8-cba5-42bb-8dae-b03b218702e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:58.285432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c6c8-cba5-42bb-8dae-b03b218702e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:58.285432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c6c8-cba5-42bb-8dae-b03b218702e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:58.286002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c6c8-cba5-42bb-8dae-b03b218702e1 admin admin] PATH_INFO: `/v3/projects/46b4817c20d84ee892f02d2807236842/users/f2d539c6f0f442b796a4c779d51100a6/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:58.295555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23c6c8-cba5-42bb-8dae-b03b218702e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b4817c20d84ee892f02d2807236842, user_id=f2d539c6f0f442b796a4c779d51100a6, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:58.301517 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23c6c8-cba5-42bb-8dae-b03b218702e1 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:58.344344 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 919/1854] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:58 2022] PUT /identity/v3/projects/46b4817c20d84ee892f02d2807236842/users/f2d539c6f0f442b796a4c779d51100a6/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:58.360175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0beb95-95a1-423f-8a32-835b07f594d9 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:58.360654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0beb95-95a1-423f-8a32-835b07f594d9 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:58.362219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0beb95-95a1-423f-8a32-835b07f594d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:58.429000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-aa0beb95-95a1-423f-8a32-835b07f594d9 None None] MFA Rules not processed for user `f2d539c6f0f442b796a4c779d51100a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:58.430284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-aa0beb95-95a1-423f-8a32-835b07f594d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:58.448518 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925d7bd-4f46-461a-8aed-ef56478a8a1c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:58.558221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8aa3-2d97-4159-9df3-8ae8aad5f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:58.559106 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8aa3-2d97-4159-9df3-8ae8aad5f0da admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:58.559516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8aa3-2d97-4159-9df3-8ae8aad5f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:58.559942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8aa3-2d97-4159-9df3-8ae8aad5f0da admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:58.560963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8aa3-2d97-4159-9df3-8ae8aad5f0da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:58.563360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8aa3-2d97-4159-9df3-8ae8aad5f0da admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:58.570298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 920/1855] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:58.571914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0beb95-95a1-423f-8a32-835b07f594d9 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:58.574193 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-aa0beb95-95a1-423f-8a32-835b07f594d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:58.592351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0beb95-95a1-423f-8a32-835b07f594d9 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:58.598777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:58.599740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:58.600138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:58.600385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] PATH_INFO: `/v3/users/36d257a309794801a0da278cd06e436d` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:58.600704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 936/1856] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:52:58 2022] POST /identity/v3/projects => generated 365 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:58.601607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d257a309794801a0da278cd06e436d)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:58.604198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8aa3-2d97-4159-9df3-8ae8aad5f0da admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:58.607344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f05a8aa3-2d97-4159-9df3-8ae8aad5f0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:58.610348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:58.697318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8aa3-2d97-4159-9df3-8ae8aad5f0da admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:58.702654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc666fa-05dd-4cc4-a4d8-b0a5adbc4735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:58.703563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc666fa-05dd-4cc4-a4d8-b0a5adbc4735 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:58.703938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc666fa-05dd-4cc4-a4d8-b0a5adbc4735 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:58.710462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc666fa-05dd-4cc4-a4d8-b0a5adbc4735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:58.803869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d257a309794801a0da278cd06e436d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:58.813799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc666fa-05dd-4cc4-a4d8-b0a5adbc4735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:58.816261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc666fa-05dd-4cc4-a4d8-b0a5adbc4735 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:58.831201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 937/1857] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:58.832300 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc666fa-05dd-4cc4-a4d8-b0a5adbc4735 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:58.850956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d257a309794801a0da278cd06e436d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:58.853610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d257a309794801a0da278cd06e436d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:58.870768 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d257a309794801a0da278cd06e436d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:58.875962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d257a309794801a0da278cd06e436d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:58.905527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 921/1858] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:52:58 2022] DELETE /identity/v3/users/36d257a309794801a0da278cd06e436d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:58.906788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:58.908257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:58.911434 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc666fa-05dd-4cc4-a4d8-b0a5adbc4735 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:59.032458 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb77c9-d018-48df-b1ed-849a6efc2c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:59.033218 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb77c9-d018-48df-b1ed-849a6efc2c94 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.033563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb77c9-d018-48df-b1ed-849a6efc2c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.033898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb77c9-d018-48df-b1ed-849a6efc2c94 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.034699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb77c9-d018-48df-b1ed-849a6efc2c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:59.040119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb77c9-d018-48df-b1ed-849a6efc2c94 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:59.050272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae303e-ca00-483f-872b-022105cafebc admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:59.061478 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:59.065492 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.066282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.067287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] PATH_INFO: `/v3/projects/8a9ac3f0cfbb47a09489b549f77f13ca` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.069615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9ac3f0cfbb47a09489b549f77f13ca)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:59.071947 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:59.087396 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 938/1859] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:52:58 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:52:59.093203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c78adb-e517-47d4-a7d7-ce24e462e425 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.093443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c78adb-e517-47d4-a7d7-ce24e462e425 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.093796 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c78adb-e517-47d4-a7d7-ce24e462e425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.133962 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-e1c78adb-e517-47d4-a7d7-ce24e462e425 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:59.138765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e1c78adb-e517-47d4-a7d7-ce24e462e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:59.168494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 939/1860] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:59.168494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c78adb-e517-47d4-a7d7-ce24e462e425 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:59.174118 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e1c78adb-e517-47d4-a7d7-ce24e462e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:59.189633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9ac3f0cfbb47a09489b549f77f13ca', 'request_id': 'req-3f0d451a-33df-412d-b95f-d94374884df6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:59.207495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c78adb-e517-47d4-a7d7-ce24e462e425 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:59.216556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9ac3f0cfbb47a09489b549f77f13ca', 'request_id': 'req-3f0d451a-33df-412d-b95f-d94374884df6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:59.238196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9ac3f0cfbb47a09489b549f77f13ca', 'request_id': 'req-3f0d451a-33df-412d-b95f-d94374884df6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:59.262442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] The token cache is being invalidate because project 8a9ac3f0cfbb47a09489b549f77f13ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:52:59.263089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:59.265141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:52:59.279748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 922/1861] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:52:58 2022] DELETE /identity/v3/projects/8a9ac3f0cfbb47a09489b549f77f13ca => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:59.282627 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:59.288862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:59.356911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749df14-ce72-4020-8611-1832ff750ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:59.357664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749df14-ce72-4020-8611-1832ff750ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.357943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749df14-ce72-4020-8611-1832ff750ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.358257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749df14-ce72-4020-8611-1832ff750ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.359198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749df14-ce72-4020-8611-1832ff750ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:59.360761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749df14-ce72-4020-8611-1832ff750ed8 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:59.399267 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 940/1862] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:59.400734 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3957-2248-4b0f-b531-ca899d44b34b None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.401003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3957-2248-4b0f-b531-ca899d44b34b None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.401284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3957-2248-4b0f-b531-ca899d44b34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.440470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-33fd3957-2248-4b0f-b531-ca899d44b34b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:59.441703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-33fd3957-2248-4b0f-b531-ca899d44b34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:59.469490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 941/1863] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:59.469490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3957-2248-4b0f-b531-ca899d44b34b None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:59.475427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-33fd3957-2248-4b0f-b531-ca899d44b34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:59.500922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3957-2248-4b0f-b531-ca899d44b34b None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:59.508343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7a4fc-6f76-4c16-b6a9-6817aea19fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:59.514500 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7a4fc-6f76-4c16-b6a9-6817aea19fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.514882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7a4fc-6f76-4c16-b6a9-6817aea19fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.515167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7a4fc-6f76-4c16-b6a9-6817aea19fa3 admin admin] PATH_INFO: `/v3/projects/869b9ece755a4f57a27c0a3709cd038c/users/9f19a323dfa0449cb5a5b1cd9f048ff3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.536584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d451a-33df-412d-b95f-d94374884df6 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:59.548634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7a4fc-6f76-4c16-b6a9-6817aea19fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869b9ece755a4f57a27c0a3709cd038c, user_id=9f19a323dfa0449cb5a5b1cd9f048ff3, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:59.550657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd325b0d-745b-4f53-8a0d-7bd74beec7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:59.551389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7a4fc-6f76-4c16-b6a9-6817aea19fa3 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:59.553364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325b0d-745b-4f53-8a0d-7bd74beec7ca service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.562039 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325b0d-745b-4f53-8a0d-7bd74beec7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.564289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325b0d-745b-4f53-8a0d-7bd74beec7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.569172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cd325b0d-745b-4f53-8a0d-7bd74beec7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:59.585144 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 942/1864] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:52:59 2022] PUT /identity/v3/projects/869b9ece755a4f57a27c0a3709cd038c/users/9f19a323dfa0449cb5a5b1cd9f048ff3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:52:59.586252 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad808fb-b1b2-420f-b364-1c36203712de None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.586540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad808fb-b1b2-420f-b364-1c36203712de None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.586818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad808fb-b1b2-420f-b364-1c36203712de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.592966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd325b0d-745b-4f53-8a0d-7bd74beec7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:59.594819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd325b0d-745b-4f53-8a0d-7bd74beec7ca service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:59.617398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 923/1865] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:59.619848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3f550-63d4-4f2f-8e06-73415ce34578 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.620632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3f550-63d4-4f2f-8e06-73415ce34578 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.620632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3f550-63d4-4f2f-8e06-73415ce34578 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.622804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fad808fb-b1b2-420f-b364-1c36203712de None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:59.622964 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 924/1866] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:52:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:59.623733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3f550-63d4-4f2f-8e06-73415ce34578 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:59.630428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fad808fb-b1b2-420f-b364-1c36203712de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:59.833947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 943/1867] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:59.835760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ba484-61bf-44c8-aea2-9f0640eb2e6c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.836359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ba484-61bf-44c8-aea2-9f0640eb2e6c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.836762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ba484-61bf-44c8-aea2-9f0640eb2e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.846849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3f550-63d4-4f2f-8e06-73415ce34578 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:59.861377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958fd96-5920-4490-8e9f-7f7d22a6a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:59.862124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958fd96-5920-4490-8e9f-7f7d22a6a51f admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.862419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958fd96-5920-4490-8e9f-7f7d22a6a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.862681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958fd96-5920-4490-8e9f-7f7d22a6a51f admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.865515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958fd96-5920-4490-8e9f-7f7d22a6a51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:59.867293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958fd96-5920-4490-8e9f-7f7d22a6a51f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:59.883354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fa6ba484-61bf-44c8-aea2-9f0640eb2e6c None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:59.885271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fa6ba484-61bf-44c8-aea2-9f0640eb2e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:59.917258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 925/1868] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:59.917258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958fd96-5920-4490-8e9f-7f7d22a6a51f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:59.949219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958fd96-5920-4490-8e9f-7f7d22a6a51f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:59.956729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166cdd2-e41c-4838-a43a-625b9b388eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:59.956729 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166cdd2-e41c-4838-a43a-625b9b388eca admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:59.956993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166cdd2-e41c-4838-a43a-625b9b388eca admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:59.957253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166cdd2-e41c-4838-a43a-625b9b388eca admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:59.958018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166cdd2-e41c-4838-a43a-625b9b388eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:52:59.958365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166cdd2-e41c-4838-a43a-625b9b388eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:59.960023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166cdd2-e41c-4838-a43a-625b9b388eca admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:00.001962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 926/1869] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:00.006502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166cdd2-e41c-4838-a43a-625b9b388eca admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:00.041843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166cdd2-e41c-4838-a43a-625b9b388eca admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:00.053788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d814e-f7fc-40fb-b5a3-49f4da11345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:00.054820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d814e-f7fc-40fb-b5a3-49f4da11345d admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:00.059147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d814e-f7fc-40fb-b5a3-49f4da11345d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:00.059438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d814e-f7fc-40fb-b5a3-49f4da11345d admin admin] PATH_INFO: `/v3/projects/869b9ece755a4f57a27c0a3709cd038c/users/9f19a323dfa0449cb5a5b1cd9f048ff3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:00.060930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 944/1870] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:52:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:00.064331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ba484-61bf-44c8-aea2-9f0640eb2e6c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:00.069418 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d814e-f7fc-40fb-b5a3-49f4da11345d admin admin] RBAC: Authorizing `identity:create_grant(project_id=869b9ece755a4f57a27c0a3709cd038c, user_id=9f19a323dfa0449cb5a5b1cd9f048ff3, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:00.071406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fa6ba484-61bf-44c8-aea2-9f0640eb2e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:00.081517 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d814e-f7fc-40fb-b5a3-49f4da11345d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:00.118011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 927/1871] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:00 2022] PUT /identity/v3/projects/869b9ece755a4f57a27c0a3709cd038c/users/9f19a323dfa0449cb5a5b1cd9f048ff3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:00.133074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d814e-f7fc-40fb-b5a3-49f4da11345d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:00.251851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ba484-61bf-44c8-aea2-9f0640eb2e6c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:00.317282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d814e-f7fc-40fb-b5a3-49f4da11345d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:00.331183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a5605-1973-43e7-9f5f-7956496ce76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:00.333676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a5605-1973-43e7-9f5f-7956496ce76a admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:00.335169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a5605-1973-43e7-9f5f-7956496ce76a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:00.343332 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a5605-1973-43e7-9f5f-7956496ce76a admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:00.345718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a5605-1973-43e7-9f5f-7956496ce76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:00.352892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a5605-1973-43e7-9f5f-7956496ce76a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:00.400381 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24278741-75ad-420f-a184-7fab230d4446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:00.403155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278741-75ad-420f-a184-7fab230d4446 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:00.403612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278741-75ad-420f-a184-7fab230d4446 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:00.404053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278741-75ad-420f-a184-7fab230d4446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:00.408481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-24278741-75ad-420f-a184-7fab230d4446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:00.431769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 928/1872] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:00 2022] POST /identity/v3/projects => generated 399 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:00.431769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8891407-eab6-43da-b128-dec9bf0d93fa None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:00.439453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8891407-eab6-43da-b128-dec9bf0d93fa None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:00.439813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8891407-eab6-43da-b128-dec9bf0d93fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:00.549978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-a8891407-eab6-43da-b128-dec9bf0d93fa None None] MFA Rules not processed for user `9f19a323dfa0449cb5a5b1cd9f048ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:00.553572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a8891407-eab6-43da-b128-dec9bf0d93fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:00.581842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24278741-75ad-420f-a184-7fab230d4446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:00.583414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24278741-75ad-420f-a184-7fab230d4446 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:00.602775 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 945/1873] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:00.604892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24278741-75ad-420f-a184-7fab230d4446 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:00.630024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24278741-75ad-420f-a184-7fab230d4446 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:00.754542 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a015bec-dd63-40aa-9758-2321b3bbf1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:00.755399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a015bec-dd63-40aa-9758-2321b3bbf1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:00.755790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a015bec-dd63-40aa-9758-2321b3bbf1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:00.756670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a015bec-dd63-40aa-9758-2321b3bbf1a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:00.757470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a015bec-dd63-40aa-9758-2321b3bbf1a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:00.762879 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 929/1874] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:00.764136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8891407-eab6-43da-b128-dec9bf0d93fa None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:00.768646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a8891407-eab6-43da-b128-dec9bf0d93fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:00.770718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a015bec-dd63-40aa-9758-2321b3bbf1a4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:00.821050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 946/1875] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:00 2022] POST /identity/v3/users => generated 300 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:00.821050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a015bec-dd63-40aa-9758-2321b3bbf1a4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:00.825846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9a015bec-dd63-40aa-9758-2321b3bbf1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:00.940401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8891407-eab6-43da-b128-dec9bf0d93fa None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:00.975509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6793f-86b9-4648-8bef-46eb2870fd1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:00.976198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6793f-86b9-4648-8bef-46eb2870fd1e service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:00.976669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6793f-86b9-4648-8bef-46eb2870fd1e service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:00.976953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6793f-86b9-4648-8bef-46eb2870fd1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:01.005495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6793f-86b9-4648-8bef-46eb2870fd1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:01.008858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6793f-86b9-4648-8bef-46eb2870fd1e service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:01.010888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a015bec-dd63-40aa-9758-2321b3bbf1a4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:01.016119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544190c9-d87b-4f77-9cef-24e740f97e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:01.017481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544190c9-d87b-4f77-9cef-24e740f97e45 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:01.018231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544190c9-d87b-4f77-9cef-24e740f97e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:01.018722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544190c9-d87b-4f77-9cef-24e740f97e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:01.033174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544190c9-d87b-4f77-9cef-24e740f97e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:01.035084 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544190c9-d87b-4f77-9cef-24e740f97e45 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:01.052349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 947/1877] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:01.052599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 930/1877] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:01.053724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544190c9-d87b-4f77-9cef-24e740f97e45 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:01.087837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544190c9-d87b-4f77-9cef-24e740f97e45 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:01.105789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c93aa-ab89-496f-a848-e3e7ab53a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:01.108318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c93aa-ab89-496f-a848-e3e7ab53a600 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:01.109593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c93aa-ab89-496f-a848-e3e7ab53a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:01.110115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c93aa-ab89-496f-a848-e3e7ab53a600 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:01.111750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c93aa-ab89-496f-a848-e3e7ab53a600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:01.131377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c93aa-ab89-496f-a848-e3e7ab53a600 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:01.177771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 948/1878] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:01.178808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6793f-86b9-4648-8bef-46eb2870fd1e service nova] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:01.193086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6793f-86b9-4648-8bef-46eb2870fd1e service nova] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:01.200216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b6f05-13b9-439a-8cba-c455243cc7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:01.201250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b6f05-13b9-439a-8cba-c455243cc7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:01.201694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b6f05-13b9-439a-8cba-c455243cc7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:01.202207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b6f05-13b9-439a-8cba-c455243cc7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:01.203173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b6f05-13b9-439a-8cba-c455243cc7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:01.205479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b6f05-13b9-439a-8cba-c455243cc7c3 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:01.261283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 931/1879] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:01.263395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c93aa-ab89-496f-a848-e3e7ab53a600 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:01.279759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c93aa-ab89-496f-a848-e3e7ab53a600 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:01.306202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b2b3d-d3da-457d-a1da-503d815b94fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:01.307477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b2b3d-d3da-457d-a1da-503d815b94fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:01.309721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b2b3d-d3da-457d-a1da-503d815b94fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:01.312814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b2b3d-d3da-457d-a1da-503d815b94fc admin admin] PATH_INFO: `/v3/projects/caecd643fe7b46a98dcaa9d9f0de3ee1/users/a4cd467e0bfc47e98aecc10edd9106ac/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:01.354899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b2b3d-d3da-457d-a1da-503d815b94fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=caecd643fe7b46a98dcaa9d9f0de3ee1, user_id=a4cd467e0bfc47e98aecc10edd9106ac, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:01.359312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b2b3d-d3da-457d-a1da-503d815b94fc admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:01.411525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 949/1880] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:01 2022] PUT /identity/v3/projects/caecd643fe7b46a98dcaa9d9f0de3ee1/users/a4cd467e0bfc47e98aecc10edd9106ac/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:01.412585 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365226a1-4b65-4633-9833-39e1adf8041a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:01.413002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365226a1-4b65-4633-9833-39e1adf8041a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:01.413377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365226a1-4b65-4633-9833-39e1adf8041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:01.483831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b2b3d-d3da-457d-a1da-503d815b94fc admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:01.486303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-737b2b3d-d3da-457d-a1da-503d815b94fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:01.515910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-365226a1-4b65-4633-9833-39e1adf8041a None None] MFA Rules not processed for user `a4cd467e0bfc47e98aecc10edd9106ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:01.518140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-365226a1-4b65-4633-9833-39e1adf8041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:01.703328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 932/1881] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:01.705406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe07df-0cd0-46c4-ba2a-34e257e988d0 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:01.705935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe07df-0cd0-46c4-ba2a-34e257e988d0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:01.706465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe07df-0cd0-46c4-ba2a-34e257e988d0 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:01.708976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 933/1882] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:53:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:53:01.709917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe07df-0cd0-46c4-ba2a-34e257e988d0 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:01.763760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b2b3d-d3da-457d-a1da-503d815b94fc admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:01.782691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:01.786227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:01.786946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:01.786946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] PATH_INFO: `/v3/projects/c355884383f94fe7aa84d43abed91572` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:01.791548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c355884383f94fe7aa84d43abed91572)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:01.801242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:01.814547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe07df-0cd0-46c4-ba2a-34e257e988d0 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:01.821377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f258cf-6b42-4b06-b91f-87ad5236c1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:01.822330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f258cf-6b42-4b06-b91f-87ad5236c1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:01.822732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f258cf-6b42-4b06-b91f-87ad5236c1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:01.822944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f258cf-6b42-4b06-b91f-87ad5236c1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:01.823703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f258cf-6b42-4b06-b91f-87ad5236c1f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:01.826483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f258cf-6b42-4b06-b91f-87ad5236c1f8 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:01.879471 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 934/1883] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:01 2022] POST /identity/v3/projects => generated 401 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:01.881219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36118e-5b48-4857-a3dc-b0fbbe902a3a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:01.881787 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36118e-5b48-4857-a3dc-b0fbbe902a3a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:01.882311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36118e-5b48-4857-a3dc-b0fbbe902a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:01.924367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ba36118e-5b48-4857-a3dc-b0fbbe902a3a None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:01.928657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ba36118e-5b48-4857-a3dc-b0fbbe902a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:01.932581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c355884383f94fe7aa84d43abed91572', 'request_id': 'req-c0a68aaa-7254-432a-9690-c1bb38b863fe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:01.947483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c355884383f94fe7aa84d43abed91572', 'request_id': 'req-c0a68aaa-7254-432a-9690-c1bb38b863fe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:01.970122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c355884383f94fe7aa84d43abed91572', 'request_id': 'req-c0a68aaa-7254-432a-9690-c1bb38b863fe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:01.995773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] The token cache is being invalidate because project c355884383f94fe7aa84d43abed91572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:01.995773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.000299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.006626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 950/1884] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:01 2022] DELETE /identity/v3/projects/c355884383f94fe7aa84d43abed91572 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:02.007801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:02.010875 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:02.121614 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 935/1885] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:53:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:02.127103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36118e-5b48-4857-a3dc-b0fbbe902a3a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:02.133465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ba36118e-5b48-4857-a3dc-b0fbbe902a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:02.237138 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a68aaa-7254-432a-9690-c1bb38b863fe admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:02.269344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5370-4348-42e8-a63c-3f287f4469a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:02.270067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5370-4348-42e8-a63c-3f287f4469a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:02.270378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5370-4348-42e8-a63c-3f287f4469a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:02.270654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d5370-4348-42e8-a63c-3f287f4469a7 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:02.272473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d5370-4348-42e8-a63c-3f287f4469a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:02.282651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d5370-4348-42e8-a63c-3f287f4469a7 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:02.320506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 951/1886] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:02 2022] POST /identity/v3/users => generated 307 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:02.321369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5370-4348-42e8-a63c-3f287f4469a7 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:02.333387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f37d5370-4348-42e8-a63c-3f287f4469a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:02.346902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d5370-4348-42e8-a63c-3f287f4469a7 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:02.351887 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:02.352916 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:02.353499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:02.353808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] PATH_INFO: `/v3/users/7460d01353bc41c99b9cbf863f8cf327` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:02.355263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7460d01353bc41c99b9cbf863f8cf327)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:02.366336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36118e-5b48-4857-a3dc-b0fbbe902a3a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:02.367753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:02.380652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:02.381740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:02.382155 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:02.382536 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] PATH_INFO: `/v3/users/9f33506879b4483cb4b838ed588683ff` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:02.384041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f33506879b4483cb4b838ed588683ff)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:02.392272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:02.492115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7460d01353bc41c99b9cbf863f8cf327'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.499128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f33506879b4483cb4b838ed588683ff'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.533010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7460d01353bc41c99b9cbf863f8cf327'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.534170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7460d01353bc41c99b9cbf863f8cf327'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.535136 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7460d01353bc41c99b9cbf863f8cf327'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.556505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7460d01353bc41c99b9cbf863f8cf327'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.582878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f33506879b4483cb4b838ed588683ff'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.585692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f33506879b4483cb4b838ed588683ff'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.592878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 952/1887] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:02 2022] DELETE /identity/v3/users/7460d01353bc41c99b9cbf863f8cf327 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:02.594005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:02.600527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:02.617027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f33506879b4483cb4b838ed588683ff'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.617027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f33506879b4483cb4b838ed588683ff'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:02.658554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 936/1888] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:02 2022] DELETE /identity/v3/users/9f33506879b4483cb4b838ed588683ff => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:02.660092 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:02.664054 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:02.788709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b3b50-5b6c-403d-afe6-dfa1c853c3ae admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:02.798522 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd5ebe-3be4-4416-b10d-bfcb8818fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:02.799649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5ebe-3be4-4416-b10d-bfcb8818fa4e admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:02.800084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5ebe-3be4-4416-b10d-bfcb8818fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:02.800501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5ebe-3be4-4416-b10d-bfcb8818fa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:02.801644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd5ebe-3be4-4416-b10d-bfcb8818fa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:02.803673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd5ebe-3be4-4416-b10d-bfcb8818fa4e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:02.831527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 937/1889] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:02.833340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb194114-564b-4272-b265-5c36073ae70d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:02.835869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb194114-564b-4272-b265-5c36073ae70d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:02.840002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb194114-564b-4272-b265-5c36073ae70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:02.862124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-bb194114-564b-4272-b265-5c36073ae70d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:02.863813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bb194114-564b-4272-b265-5c36073ae70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:02.872494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 938/1890] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:02.873777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb194114-564b-4272-b265-5c36073ae70d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:02.884683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb194114-564b-4272-b265-5c36073ae70d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:02.888504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa8a13-04f2-4a8a-a049-c979189f5cbd admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:02.891979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b3fa4-8e07-433e-ba6a-57bb53bf0709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:02.893899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b3fa4-8e07-433e-ba6a-57bb53bf0709 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:02.894403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b3fa4-8e07-433e-ba6a-57bb53bf0709 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:02.894863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b3fa4-8e07-433e-ba6a-57bb53bf0709 admin admin] PATH_INFO: `/v3/projects/09e831dc8bad4f03807a9d07b13b48a0/users/f5f078b811a241a98dc3dc9730e35245/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:02.917649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b3fa4-8e07-433e-ba6a-57bb53bf0709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e831dc8bad4f03807a9d07b13b48a0, user_id=f5f078b811a241a98dc3dc9730e35245, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:02.923693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b3fa4-8e07-433e-ba6a-57bb53bf0709 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:02.950459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 939/1891] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:02 2022] PUT /identity/v3/projects/09e831dc8bad4f03807a9d07b13b48a0/users/f5f078b811a241a98dc3dc9730e35245/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:02.954630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b3fa4-8e07-433e-ba6a-57bb53bf0709 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:03.054977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b853e74-1457-4e1f-a751-697760450371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:03.055668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853e74-1457-4e1f-a751-697760450371 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:03.055952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853e74-1457-4e1f-a751-697760450371 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:03.057869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853e74-1457-4e1f-a751-697760450371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:03.063634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5b853e74-1457-4e1f-a751-697760450371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:03.094416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b853e74-1457-4e1f-a751-697760450371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:03.098371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b853e74-1457-4e1f-a751-697760450371 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:03.137854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 953/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:03.151042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b853e74-1457-4e1f-a751-697760450371 service nova] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:03.154879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5b853e74-1457-4e1f-a751-697760450371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:03.167712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b3fa4-8e07-433e-ba6a-57bb53bf0709 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:03.184597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffa00b-b52f-451b-8074-e0c0ec77bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:03.185653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa00b-b52f-451b-8074-e0c0ec77bf70 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:03.185653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa00b-b52f-451b-8074-e0c0ec77bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:03.185842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa00b-b52f-451b-8074-e0c0ec77bf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:03.186610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffa00b-b52f-451b-8074-e0c0ec77bf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:03.188296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffa00b-b52f-451b-8074-e0c0ec77bf70 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:03.211111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 940/1893] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:03.212455 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffa00b-b52f-451b-8074-e0c0ec77bf70 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:03.235778 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffa00b-b52f-451b-8074-e0c0ec77bf70 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:03.249526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03f3f3-cd75-4289-badd-5ba599a2009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:03.250507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03f3f3-cd75-4289-badd-5ba599a2009f admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:03.250796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03f3f3-cd75-4289-badd-5ba599a2009f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:03.251099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03f3f3-cd75-4289-badd-5ba599a2009f admin admin] PATH_INFO: `/v3/projects/09e831dc8bad4f03807a9d07b13b48a0/users/f5f078b811a241a98dc3dc9730e35245/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:03.260294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03f3f3-cd75-4289-badd-5ba599a2009f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e831dc8bad4f03807a9d07b13b48a0, user_id=f5f078b811a241a98dc3dc9730e35245, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:03.263692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03f3f3-cd75-4289-badd-5ba599a2009f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:03.287411 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 941/1894] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:03 2022] PUT /identity/v3/projects/09e831dc8bad4f03807a9d07b13b48a0/users/f5f078b811a241a98dc3dc9730e35245/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:03.307102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0968d7-5f57-4cee-8594-d3d14f22fe8f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:03.307584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0968d7-5f57-4cee-8594-d3d14f22fe8f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:03.308027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0968d7-5f57-4cee-8594-d3d14f22fe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:03.319746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b853e74-1457-4e1f-a751-697760450371 service nova] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:03.386966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3439a7-d0c8-42a2-a507-a7ab6146e0cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:03.388166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3439a7-d0c8-42a2-a507-a7ab6146e0cb service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:03.388435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3439a7-d0c8-42a2-a507-a7ab6146e0cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:03.389066 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3439a7-d0c8-42a2-a507-a7ab6146e0cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:03.389880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-4b0968d7-5f57-4cee-8594-d3d14f22fe8f None None] MFA Rules not processed for user `f5f078b811a241a98dc3dc9730e35245`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:03.405082 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4b0968d7-5f57-4cee-8594-d3d14f22fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:03.530754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3439a7-d0c8-42a2-a507-a7ab6146e0cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:03.532543 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3439a7-d0c8-42a2-a507-a7ab6146e0cb service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:03.561440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 954/1895] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:03.587815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 942/1896] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:03.590579 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3439a7-d0c8-42a2-a507-a7ab6146e0cb service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:03.593084 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0c3439a7-d0c8-42a2-a507-a7ab6146e0cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:03.757874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3439a7-d0c8-42a2-a507-a7ab6146e0cb service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:03.764355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6d03-b633-439c-a190-0bc65a9e02ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:03.765211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6d03-b633-439c-a190-0bc65a9e02ad service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:03.765698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6d03-b633-439c-a190-0bc65a9e02ad service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:03.765983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6d03-b633-439c-a190-0bc65a9e02ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:03.782571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6d03-b633-439c-a190-0bc65a9e02ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:03.784786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6d03-b633-439c-a190-0bc65a9e02ad service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:03.817362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 955/1897] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:04.062666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0968d7-5f57-4cee-8594-d3d14f22fe8f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:04.064670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4b0968d7-5f57-4cee-8594-d3d14f22fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:04.079060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0968d7-5f57-4cee-8594-d3d14f22fe8f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:04.083134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2d5ce-d887-423a-8a2f-886641361368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:04.084235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2d5ce-d887-423a-8a2f-886641361368 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:04.084748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2d5ce-d887-423a-8a2f-886641361368 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:04.085258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2d5ce-d887-423a-8a2f-886641361368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:04.087452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-baf2d5ce-d887-423a-8a2f-886641361368 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:04.156971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2d5ce-d887-423a-8a2f-886641361368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:04.159196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2d5ce-d887-423a-8a2f-886641361368 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:04.182140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 943/1898] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:04.861049 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6d03-b633-439c-a190-0bc65a9e02ad service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:04.863253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-758d6d03-b633-439c-a190-0bc65a9e02ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:04.885786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6d03-b633-439c-a190-0bc65a9e02ad service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:04.891735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:04.892631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:04.892905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:04.893187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] PATH_INFO: `/v3/projects/9fa74c9360e547c5951e417164a9e167` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:04.894539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa74c9360e547c5951e417164a9e167)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:04.896476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:04.966070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa74c9360e547c5951e417164a9e167', 'request_id': 'req-cec9d581-252d-42dd-94ce-874672b64779'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:04.974067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa74c9360e547c5951e417164a9e167', 'request_id': 'req-cec9d581-252d-42dd-94ce-874672b64779'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:04.983890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa74c9360e547c5951e417164a9e167', 'request_id': 'req-cec9d581-252d-42dd-94ce-874672b64779'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:04.995387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] The token cache is being invalidate because project 9fa74c9360e547c5951e417164a9e167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:04.995830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:04.996477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:04.998531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 956/1899] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:04 2022] DELETE /identity/v3/projects/9fa74c9360e547c5951e417164a9e167 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:05.003519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2f58b-73b6-44bf-ab6a-e03229fab73c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.003810 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2f58b-73b6-44bf-ab6a-e03229fab73c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.004093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2f58b-73b6-44bf-ab6a-e03229fab73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.027277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-fda2f58b-73b6-44bf-ab6a-e03229fab73c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:05.028834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-fda2f58b-73b6-44bf-ab6a-e03229fab73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:05.082694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:05.084834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:05.158620 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 944/1900] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:05.159878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9d581-252d-42dd-94ce-874672b64779 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:05.166202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:05.166689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.166969 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.167241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] PATH_INFO: `/v3/projects/0b28723a94874c4483bfad112e9ac02d` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.167991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c517-3879-431e-a6b4-1328898d532d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.168276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c517-3879-431e-a6b4-1328898d532d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.168547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c517-3879-431e-a6b4-1328898d532d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.168654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b28723a94874c4483bfad112e9ac02d)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:05.170546 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:05.196461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d0a9c517-3879-431e-a6b4-1328898d532d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:05.197785 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d0a9c517-3879-431e-a6b4-1328898d532d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:05.207333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 945/1901] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:05.211388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9c517-3879-431e-a6b4-1328898d532d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:05.225186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9c517-3879-431e-a6b4-1328898d532d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:05.242882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b28723a94874c4483bfad112e9ac02d', 'request_id': 'req-3cb81d3a-a211-491b-8a91-4c92e301acf1'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:05.249837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b28723a94874c4483bfad112e9ac02d', 'request_id': 'req-3cb81d3a-a211-491b-8a91-4c92e301acf1'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:05.260811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b28723a94874c4483bfad112e9ac02d', 'request_id': 'req-3cb81d3a-a211-491b-8a91-4c92e301acf1'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:05.277594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] The token cache is being invalidate because project 0b28723a94874c4483bfad112e9ac02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:05.278683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:05.279846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:05.282418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 957/1902] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:05 2022] DELETE /identity/v3/projects/0b28723a94874c4483bfad112e9ac02d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:05.286457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:05.287994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:05.307562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35803b13-0375-4c63-aa46-c41f169f6345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:05.308530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35803b13-0375-4c63-aa46-c41f169f6345 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.308966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35803b13-0375-4c63-aa46-c41f169f6345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.309839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35803b13-0375-4c63-aa46-c41f169f6345 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.311226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35803b13-0375-4c63-aa46-c41f169f6345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:05.311743 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35803b13-0375-4c63-aa46-c41f169f6345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:05.313535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35803b13-0375-4c63-aa46-c41f169f6345 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:05.332830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 946/1903] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:05.333887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35803b13-0375-4c63-aa46-c41f169f6345 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:05.337616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-35803b13-0375-4c63-aa46-c41f169f6345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:05.357069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35803b13-0375-4c63-aa46-c41f169f6345 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:05.364316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c0d7-79d5-4ae8-a504-d7f234639a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:05.365083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c0d7-79d5-4ae8-a504-d7f234639a4e admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.365452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c0d7-79d5-4ae8-a504-d7f234639a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.365731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c0d7-79d5-4ae8-a504-d7f234639a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.366525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7c0d7-79d5-4ae8-a504-d7f234639a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:05.369380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7c0d7-79d5-4ae8-a504-d7f234639a4e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:05.393817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb81d3a-a211-491b-8a91-4c92e301acf1 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:05.399153 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:05.400047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.400473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.400835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] PATH_INFO: `/v3/users/9f19a323dfa0449cb5a5b1cd9f048ff3` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.401933 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f19a323dfa0449cb5a5b1cd9f048ff3)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:05.403957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:05.448629 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 947/1904] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:05 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:05.453175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c0d7-79d5-4ae8-a504-d7f234639a4e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:05.481241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f19a323dfa0449cb5a5b1cd9f048ff3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:05.512234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f19a323dfa0449cb5a5b1cd9f048ff3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:05.513280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f19a323dfa0449cb5a5b1cd9f048ff3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:05.514418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f19a323dfa0449cb5a5b1cd9f048ff3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:05.529679 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f19a323dfa0449cb5a5b1cd9f048ff3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:05.540059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c0d7-79d5-4ae8-a504-d7f234639a4e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:05.547215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32983d-b42a-42d3-aafc-90dbc8c939bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:05.548962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32983d-b42a-42d3-aafc-90dbc8c939bf admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.549566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32983d-b42a-42d3-aafc-90dbc8c939bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.550145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32983d-b42a-42d3-aafc-90dbc8c939bf admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.551209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32983d-b42a-42d3-aafc-90dbc8c939bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:05.553848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32983d-b42a-42d3-aafc-90dbc8c939bf admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:05.560675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 958/1905] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:05 2022] DELETE /identity/v3/users/9f19a323dfa0449cb5a5b1cd9f048ff3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:05.609329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 948/1906] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:05 2022] POST /identity/v3/users => generated 282 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:05.613105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:05.615190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:05.730779 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32983d-b42a-42d3-aafc-90dbc8c939bf admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:05.732756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4e32983d-b42a-42d3-aafc-90dbc8c939bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:05.767327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef3a6d-3f95-45be-a49c-f209f60bea63 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:05.783020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de4611-8a4a-4f78-8887-9196ba210f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:05.783748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de4611-8a4a-4f78-8887-9196ba210f6b admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.784031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de4611-8a4a-4f78-8887-9196ba210f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.784306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de4611-8a4a-4f78-8887-9196ba210f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.785307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de4611-8a4a-4f78-8887-9196ba210f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:05.788040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de4611-8a4a-4f78-8887-9196ba210f6b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:05.808549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32983d-b42a-42d3-aafc-90dbc8c939bf admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:05.831986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 959/1907] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:05.834678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de4611-8a4a-4f78-8887-9196ba210f6b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:05.850129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de4611-8a4a-4f78-8887-9196ba210f6b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:05.857536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c72ab6-4531-4793-891d-12f2ab0cc00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:05.858331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c72ab6-4531-4793-891d-12f2ab0cc00a admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.858647 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c72ab6-4531-4793-891d-12f2ab0cc00a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.859672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c72ab6-4531-4793-891d-12f2ab0cc00a admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.859971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c72ab6-4531-4793-891d-12f2ab0cc00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:05.861689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c72ab6-4531-4793-891d-12f2ab0cc00a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:05.883316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 960/1908] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:05.884383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c72ab6-4531-4793-891d-12f2ab0cc00a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:05.890830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3dcb5-d784-4181-a50a-9740e91c3009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:05.891849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3dcb5-d784-4181-a50a-9740e91c3009 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.892312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3dcb5-d784-4181-a50a-9740e91c3009 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.892760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3dcb5-d784-4181-a50a-9740e91c3009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.895275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-11c3dcb5-d784-4181-a50a-9740e91c3009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:05.898535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c72ab6-4531-4793-891d-12f2ab0cc00a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:05.905625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d9040-73bc-4444-92d2-66b779d7ec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:05.906659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9040-73bc-4444-92d2-66b779d7ec18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:05.906942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9040-73bc-4444-92d2-66b779d7ec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:05.907310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9040-73bc-4444-92d2-66b779d7ec18 admin admin] PATH_INFO: `/v3/projects/2d6d637a00454e089942fe0a02204ab0/users/29d2b6fb026f4825ba9655f5bb98b450/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:05.932107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d9040-73bc-4444-92d2-66b779d7ec18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6d637a00454e089942fe0a02204ab0, user_id=29d2b6fb026f4825ba9655f5bb98b450, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:05.937003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d9040-73bc-4444-92d2-66b779d7ec18 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.009065 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 961/1909] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:05 2022] PUT /identity/v3/projects/2d6d637a00454e089942fe0a02204ab0/users/29d2b6fb026f4825ba9655f5bb98b450/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:06.031037 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e758a-f7d5-41fa-91dd-f374e72af71c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.031559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e758a-f7d5-41fa-91dd-f374e72af71c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.032009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e758a-f7d5-41fa-91dd-f374e72af71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.039123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3dcb5-d784-4181-a50a-9740e91c3009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.041586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3dcb5-d784-4181-a50a-9740e91c3009 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.058766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 949/1910] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:06.080054 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-566e758a-f7d5-41fa-91dd-f374e72af71c None None] MFA Rules not processed for user `29d2b6fb026f4825ba9655f5bb98b450`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:06.082604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-566e758a-f7d5-41fa-91dd-f374e72af71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:06.184066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3dcb5-d784-4181-a50a-9740e91c3009 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.185588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-11c3dcb5-d784-4181-a50a-9740e91c3009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:06.209368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 962/1911] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:06.210319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e758a-f7d5-41fa-91dd-f374e72af71c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.217946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3dcb5-d784-4181-a50a-9740e91c3009 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.319986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e758a-f7d5-41fa-91dd-f374e72af71c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.322612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.323635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.324623 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.325049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] PATH_INFO: `/v3/projects/869b9ece755a4f57a27c0a3709cd038c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.326538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=869b9ece755a4f57a27c0a3709cd038c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.329226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.334003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6be78b-9491-46df-a55a-99ad06c488fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.334737 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6be78b-9491-46df-a55a-99ad06c488fb admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.335065 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6be78b-9491-46df-a55a-99ad06c488fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.335339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6be78b-9491-46df-a55a-99ad06c488fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.336259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6be78b-9491-46df-a55a-99ad06c488fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.338481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6be78b-9491-46df-a55a-99ad06c488fb admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.380828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 963/1912] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:06 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:06.384943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6be78b-9491-46df-a55a-99ad06c488fb admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.388249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869b9ece755a4f57a27c0a3709cd038c', 'request_id': 'req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:06.398574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869b9ece755a4f57a27c0a3709cd038c', 'request_id': 'req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:06.408165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869b9ece755a4f57a27c0a3709cd038c', 'request_id': 'req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:06.427759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] The token cache is being invalidate because project 869b9ece755a4f57a27c0a3709cd038c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:06.428075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:06.430116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-db6d1bac-10b5-4c77-9cc1-88d301a9f5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:06.433189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 950/1913] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:06 2022] DELETE /identity/v3/projects/869b9ece755a4f57a27c0a3709cd038c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:06.437808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ab493-fdce-43a5-85ec-aee1af97071f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.438107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ab493-fdce-43a5-85ec-aee1af97071f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.438382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ab493-fdce-43a5-85ec-aee1af97071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.470474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ee5ab493-fdce-43a5-85ec-aee1af97071f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:06.475930 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ee5ab493-fdce-43a5-85ec-aee1af97071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:06.503387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6be78b-9491-46df-a55a-99ad06c488fb admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.508506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7903002-9fa5-4733-a74d-b94d5d5caf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.509250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7903002-9fa5-4733-a74d-b94d5d5caf17 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.509530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7903002-9fa5-4733-a74d-b94d5d5caf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.509797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7903002-9fa5-4733-a74d-b94d5d5caf17 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.510925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7903002-9fa5-4733-a74d-b94d5d5caf17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.512865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7903002-9fa5-4733-a74d-b94d5d5caf17 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.542644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 964/1914] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:06 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:06.547006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7903002-9fa5-4733-a74d-b94d5d5caf17 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.548905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e7903002-9fa5-4733-a74d-b94d5d5caf17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:06.568518 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7903002-9fa5-4733-a74d-b94d5d5caf17 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.568715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 951/1915] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:06.568807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b6242-c80a-49ac-8c5e-3b23c7d2df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.568807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6242-c80a-49ac-8c5e-3b23c7d2df4b admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.568807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6242-c80a-49ac-8c5e-3b23c7d2df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.569340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6242-c80a-49ac-8c5e-3b23c7d2df4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.569891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b6242-c80a-49ac-8c5e-3b23c7d2df4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.570241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28456-4574-4656-bb9b-35fd95010b61 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.570553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28456-4574-4656-bb9b-35fd95010b61 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.571323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28456-4574-4656-bb9b-35fd95010b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.572029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b6242-c80a-49ac-8c5e-3b23c7d2df4b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.586104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 965/1916] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:06.588187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b6242-c80a-49ac-8c5e-3b23c7d2df4b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.593045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-64e28456-4574-4656-bb9b-35fd95010b61 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:06.594860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-64e28456-4574-4656-bb9b-35fd95010b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:06.603041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 952/1917] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:06.604437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b6242-c80a-49ac-8c5e-3b23c7d2df4b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.607043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28456-4574-4656-bb9b-35fd95010b61 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.610061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5ac51-2b84-4b52-805d-f2f7a8f8ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.611167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5ac51-2b84-4b52-805d-f2f7a8f8ff20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.611520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5ac51-2b84-4b52-805d-f2f7a8f8ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.611805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5ac51-2b84-4b52-805d-f2f7a8f8ff20 admin admin] PATH_INFO: `/v3/projects/528ad1c92bfc4c4d8dfcd10b7863d8a7/users/03b306976276458396439f0612b894d3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.617033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28456-4574-4656-bb9b-35fd95010b61 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.623215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1314bc-8df6-4ae0-9ab2-cbacc4c90e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.623817 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1314bc-8df6-4ae0-9ab2-cbacc4c90e3b admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.624162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1314bc-8df6-4ae0-9ab2-cbacc4c90e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.624578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1314bc-8df6-4ae0-9ab2-cbacc4c90e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.625181 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1314bc-8df6-4ae0-9ab2-cbacc4c90e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:06.625784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1314bc-8df6-4ae0-9ab2-cbacc4c90e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.627273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1314bc-8df6-4ae0-9ab2-cbacc4c90e3b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.627988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5ac51-2b84-4b52-805d-f2f7a8f8ff20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=528ad1c92bfc4c4d8dfcd10b7863d8a7, user_id=03b306976276458396439f0612b894d3, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.630798 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5ac51-2b84-4b52-805d-f2f7a8f8ff20 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.646171 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 953/1918] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:06.649789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 966/1919] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:06 2022] PUT /identity/v3/projects/528ad1c92bfc4c4d8dfcd10b7863d8a7/users/03b306976276458396439f0612b894d3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:06.649941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1314bc-8df6-4ae0-9ab2-cbacc4c90e3b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.650742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5ac51-2b84-4b52-805d-f2f7a8f8ff20 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.664129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1314bc-8df6-4ae0-9ab2-cbacc4c90e3b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.724144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f55ff-92c9-4b2d-a772-6a40b940b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.725020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f55ff-92c9-4b2d-a772-6a40b940b383 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.725212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5ac51-2b84-4b52-805d-f2f7a8f8ff20 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.725316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f55ff-92c9-4b2d-a772-6a40b940b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.725558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f55ff-92c9-4b2d-a772-6a40b940b383 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.726580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f55ff-92c9-4b2d-a772-6a40b940b383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.728334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f55ff-92c9-4b2d-a772-6a40b940b383 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.730930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8c45-b7a6-46e4-9b2c-c515d7c9d3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.731898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8c45-b7a6-46e4-9b2c-c515d7c9d3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.732885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8c45-b7a6-46e4-9b2c-c515d7c9d3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.733283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8c45-b7a6-46e4-9b2c-c515d7c9d3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.734227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8c45-b7a6-46e4-9b2c-c515d7c9d3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.736086 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8c45-b7a6-46e4-9b2c-c515d7c9d3d2 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.746539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 967/1920] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:06.752427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8c45-b7a6-46e4-9b2c-c515d7c9d3d2 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.758238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 954/1921] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:06 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:06.762447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f55ff-92c9-4b2d-a772-6a40b940b383 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.763908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8c45-b7a6-46e4-9b2c-c515d7c9d3d2 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.838334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f55ff-92c9-4b2d-a772-6a40b940b383 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.838334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b72f-f8dc-4632-bcd2-c6203f98cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.838334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b72f-f8dc-4632-bcd2-c6203f98cf07 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.838334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b72f-f8dc-4632-bcd2-c6203f98cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.838702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b72f-f8dc-4632-bcd2-c6203f98cf07 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.838702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28b72f-f8dc-4632-bcd2-c6203f98cf07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.838702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28b72f-f8dc-4632-bcd2-c6203f98cf07 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.840978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b8649-2809-4b04-9a1f-22f965d3040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.841948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b8649-2809-4b04-9a1f-22f965d3040d admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.842231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b8649-2809-4b04-9a1f-22f965d3040d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.842514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b8649-2809-4b04-9a1f-22f965d3040d admin admin] PATH_INFO: `/v3/projects/528ad1c92bfc4c4d8dfcd10b7863d8a7/users/03b306976276458396439f0612b894d3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.847289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b8649-2809-4b04-9a1f-22f965d3040d admin admin] RBAC: Authorizing `identity:create_grant(project_id=528ad1c92bfc4c4d8dfcd10b7863d8a7, user_id=03b306976276458396439f0612b894d3, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.849849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b8649-2809-4b04-9a1f-22f965d3040d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:06.863240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 955/1922] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:06 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:06.866139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 968/1923] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:06 2022] PUT /identity/v3/projects/528ad1c92bfc4c4d8dfcd10b7863d8a7/users/03b306976276458396439f0612b894d3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:06.867460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b72f-f8dc-4632-bcd2-c6203f98cf07 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:06.878583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814aa81-9a5b-43f8-bf88-32d963edd9af None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.878865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814aa81-9a5b-43f8-bf88-32d963edd9af None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.879140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814aa81-9a5b-43f8-bf88-32d963edd9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.884289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b72f-f8dc-4632-bcd2-c6203f98cf07 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:06.908729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-f814aa81-9a5b-43f8-bf88-32d963edd9af None None] MFA Rules not processed for user `03b306976276458396439f0612b894d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:06.910008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f814aa81-9a5b-43f8-bf88-32d963edd9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:06.985399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebaa4a-65d1-4f70-8052-d3697d04e665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:06.986680 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebaa4a-65d1-4f70-8052-d3697d04e665 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:06.987377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebaa4a-65d1-4f70-8052-d3697d04e665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:06.987842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebaa4a-65d1-4f70-8052-d3697d04e665 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:06.989265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebaa4a-65d1-4f70-8052-d3697d04e665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:06.991099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebaa4a-65d1-4f70-8052-d3697d04e665 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.000412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 969/1924] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:07.006209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 956/1925] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:07.009630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814aa81-9a5b-43f8-bf88-32d963edd9af None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.022622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814aa81-9a5b-43f8-bf88-32d963edd9af None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.029516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1db59-8046-4e14-8440-d4a8a548aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.030301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1db59-8046-4e14-8440-d4a8a548aab4 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.031914 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1db59-8046-4e14-8440-d4a8a548aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.031914 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1db59-8046-4e14-8440-d4a8a548aab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.031914 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1db59-8046-4e14-8440-d4a8a548aab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.033632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1db59-8046-4e14-8440-d4a8a548aab4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.046371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 970/1926] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:07.050058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebaa4a-65d1-4f70-8052-d3697d04e665 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.051683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1db59-8046-4e14-8440-d4a8a548aab4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.052393 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b9ebaa4a-65d1-4f70-8052-d3697d04e665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:07.077879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1db59-8046-4e14-8440-d4a8a548aab4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.095003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27c796-4c66-47a4-af01-f41521fd6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.096201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27c796-4c66-47a4-af01-f41521fd6fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.096629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27c796-4c66-47a4-af01-f41521fd6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.096911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27c796-4c66-47a4-af01-f41521fd6fbc admin admin] PATH_INFO: `/v3/projects/9634552b055e48e2a84ad722a06b5ec4/users/f7e341d336174e42babf2a98618dc4fc/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.122325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27c796-4c66-47a4-af01-f41521fd6fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9634552b055e48e2a84ad722a06b5ec4, user_id=f7e341d336174e42babf2a98618dc4fc, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.125035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27c796-4c66-47a4-af01-f41521fd6fbc admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.145200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 971/1927] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:07 2022] PUT /identity/v3/projects/9634552b055e48e2a84ad722a06b5ec4/users/f7e341d336174e42babf2a98618dc4fc/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:07.155966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e463fbd-6dbe-40ac-a651-0f77f4abac4f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.156477 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e463fbd-6dbe-40ac-a651-0f77f4abac4f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.157698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e463fbd-6dbe-40ac-a651-0f77f4abac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.166933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebaa4a-65d1-4f70-8052-d3697d04e665 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.201197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6e463fbd-6dbe-40ac-a651-0f77f4abac4f None None] MFA Rules not processed for user `f7e341d336174e42babf2a98618dc4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:07.202742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6e463fbd-6dbe-40ac-a651-0f77f4abac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:07.225197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a442e88-1a04-4b05-8d9d-290bdea735ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.226217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a442e88-1a04-4b05-8d9d-290bdea735ea service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.226217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a442e88-1a04-4b05-8d9d-290bdea735ea service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.226519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a442e88-1a04-4b05-8d9d-290bdea735ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.276537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 972/1928] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:07.281079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e463fbd-6dbe-40ac-a651-0f77f4abac4f None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.301885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a442e88-1a04-4b05-8d9d-290bdea735ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.303574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a442e88-1a04-4b05-8d9d-290bdea735ea service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.313809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 957/1929] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:07.343501 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e463fbd-6dbe-40ac-a651-0f77f4abac4f None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.349448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb001fd-a390-4058-b547-9dcda61871b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.350140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb001fd-a390-4058-b547-9dcda61871b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.350648 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb001fd-a390-4058-b547-9dcda61871b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.350930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb001fd-a390-4058-b547-9dcda61871b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.351624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb001fd-a390-4058-b547-9dcda61871b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.353733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb001fd-a390-4058-b547-9dcda61871b1 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.381882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 973/1930] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:07 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:07.386145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a442e88-1a04-4b05-8d9d-290bdea735ea service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.389169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb001fd-a390-4058-b547-9dcda61871b1 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.397030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a442e88-1a04-4b05-8d9d-290bdea735ea service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.446056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb001fd-a390-4058-b547-9dcda61871b1 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.459058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819de969-c91b-4d1b-b237-bfd77a277feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.459499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8878b-49a0-403f-a9b2-3fc7999a4fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.459795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de969-c91b-4d1b-b237-bfd77a277feb admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.460079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de969-c91b-4d1b-b237-bfd77a277feb admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.460172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8878b-49a0-403f-a9b2-3fc7999a4fca service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.460351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de969-c91b-4d1b-b237-bfd77a277feb admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.460442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8878b-49a0-403f-a9b2-3fc7999a4fca service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.460804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8878b-49a0-403f-a9b2-3fc7999a4fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.461032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819de969-c91b-4d1b-b237-bfd77a277feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.462687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0dc8878b-49a0-403f-a9b2-3fc7999a4fca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:07.463429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819de969-c91b-4d1b-b237-bfd77a277feb admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.492567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 958/1931] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:07 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:07.493759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819de969-c91b-4d1b-b237-bfd77a277feb admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.508444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819de969-c91b-4d1b-b237-bfd77a277feb admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.513516 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830e3bb-c0f1-4e50-9e1c-bd08debb6385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.514295 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830e3bb-c0f1-4e50-9e1c-bd08debb6385 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.515792 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830e3bb-c0f1-4e50-9e1c-bd08debb6385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.518579 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830e3bb-c0f1-4e50-9e1c-bd08debb6385 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.522507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830e3bb-c0f1-4e50-9e1c-bd08debb6385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.524823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830e3bb-c0f1-4e50-9e1c-bd08debb6385 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.539376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 959/1932] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:07.543258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830e3bb-c0f1-4e50-9e1c-bd08debb6385 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.551107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8878b-49a0-403f-a9b2-3fc7999a4fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.552662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8878b-49a0-403f-a9b2-3fc7999a4fca service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.553009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830e3bb-c0f1-4e50-9e1c-bd08debb6385 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.559479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303685c3-052a-470b-a4e6-4afa570ee38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.559479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303685c3-052a-470b-a4e6-4afa570ee38b admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.559479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303685c3-052a-470b-a4e6-4afa570ee38b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.559479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303685c3-052a-470b-a4e6-4afa570ee38b admin admin] PATH_INFO: `/v3/projects/0f0e776a99c3451eb56bbf6542dd8acd/users/e113eb4774a14186845834d46b59be5f/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.567171 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 974/1933] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:07.591347 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303685c3-052a-470b-a4e6-4afa570ee38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0e776a99c3451eb56bbf6542dd8acd, user_id=e113eb4774a14186845834d46b59be5f, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.594114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303685c3-052a-470b-a4e6-4afa570ee38b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.613828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 960/1934] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:07 2022] PUT /identity/v3/projects/0f0e776a99c3451eb56bbf6542dd8acd/users/e113eb4774a14186845834d46b59be5f/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:07.617779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8878b-49a0-403f-a9b2-3fc7999a4fca service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.630767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8878b-49a0-403f-a9b2-3fc7999a4fca service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.733682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2781229-4d49-456d-95de-a6f34bd5b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.734720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2781229-4d49-456d-95de-a6f34bd5b267 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.735063 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2781229-4d49-456d-95de-a6f34bd5b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.735414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2781229-4d49-456d-95de-a6f34bd5b267 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.736317 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2781229-4d49-456d-95de-a6f34bd5b267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.738432 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2781229-4d49-456d-95de-a6f34bd5b267 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.754169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 975/1935] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:07.755640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303685c3-052a-470b-a4e6-4afa570ee38b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.766242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303685c3-052a-470b-a4e6-4afa570ee38b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.770880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c32ff3-c515-415e-8ac7-846c29fbd6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.771812 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c32ff3-c515-415e-8ac7-846c29fbd6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.772135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c32ff3-c515-415e-8ac7-846c29fbd6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.772404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c32ff3-c515-415e-8ac7-846c29fbd6ae admin admin] PATH_INFO: `/v3/projects/0f0e776a99c3451eb56bbf6542dd8acd/users/e113eb4774a14186845834d46b59be5f/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.774441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c32ff3-c515-415e-8ac7-846c29fbd6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0e776a99c3451eb56bbf6542dd8acd, user_id=e113eb4774a14186845834d46b59be5f, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.777108 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c32ff3-c515-415e-8ac7-846c29fbd6ae admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.788179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 961/1936] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:07 2022] PUT /identity/v3/projects/0f0e776a99c3451eb56bbf6542dd8acd/users/e113eb4774a14186845834d46b59be5f/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:07.799816 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cda00-628e-4ba8-8c99-ca1efde343da None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.800104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cda00-628e-4ba8-8c99-ca1efde343da None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.800376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cda00-628e-4ba8-8c99-ca1efde343da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.827812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-1d8cda00-628e-4ba8-8c99-ca1efde343da None None] MFA Rules not processed for user `e113eb4774a14186845834d46b59be5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:07.829009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1d8cda00-628e-4ba8-8c99-ca1efde343da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:07.902790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 976/1937] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:07.915129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c32ff3-c515-415e-8ac7-846c29fbd6ae admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:07.971755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c32ff3-c515-415e-8ac7-846c29fbd6ae admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:07.975758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619b1e4-554c-42ed-8e2d-ee171343e64d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:07.976443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619b1e4-554c-42ed-8e2d-ee171343e64d service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:07.976722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619b1e4-554c-42ed-8e2d-ee171343e64d service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:07.976997 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619b1e4-554c-42ed-8e2d-ee171343e64d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:07.987121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619b1e4-554c-42ed-8e2d-ee171343e64d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:07.988489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619b1e4-554c-42ed-8e2d-ee171343e64d service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:07.998267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 962/1938] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:08.076883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cda00-628e-4ba8-8c99-ca1efde343da None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:08.078438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1d8cda00-628e-4ba8-8c99-ca1efde343da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:08.091108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cda00-628e-4ba8-8c99-ca1efde343da None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:08.095622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e4834-a9af-4154-aad2-1690c47c5049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:08.096385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e4834-a9af-4154-aad2-1690c47c5049 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:08.096662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e4834-a9af-4154-aad2-1690c47c5049 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:08.096939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e4834-a9af-4154-aad2-1690c47c5049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:08.159149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e4834-a9af-4154-aad2-1690c47c5049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:08.160598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e4834-a9af-4154-aad2-1690c47c5049 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:08.169982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 977/1939] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:08.781483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619b1e4-554c-42ed-8e2d-ee171343e64d service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:08.783841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e619b1e4-554c-42ed-8e2d-ee171343e64d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:08.917874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619b1e4-554c-42ed-8e2d-ee171343e64d service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:08.917874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:08.917874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:08.917874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:08.918325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] PATH_INFO: `/v3/users/23339b37c7b946449eb5e06a0504b0f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:08.919494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=23339b37c7b946449eb5e06a0504b0f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:08.921702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:08.952385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e4834-a9af-4154-aad2-1690c47c5049 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:08.954894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d45e4834-a9af-4154-aad2-1690c47c5049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:08.972283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e4834-a9af-4154-aad2-1690c47c5049 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:08.978684 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:08.980197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:08.981121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:08.981598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] PATH_INFO: `/v3/users/a4cd467e0bfc47e98aecc10edd9106ac` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:08.983020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cd467e0bfc47e98aecc10edd9106ac)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:08.985139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:09.012564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23339b37c7b946449eb5e06a0504b0f9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:09.039979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23339b37c7b946449eb5e06a0504b0f9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:09.041245 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23339b37c7b946449eb5e06a0504b0f9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:09.058276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23339b37c7b946449eb5e06a0504b0f9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:09.058276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-14322346-9773-4f9b-a8f6-a9755ab178ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23339b37c7b946449eb5e06a0504b0f9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:09.065936 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cd467e0bfc47e98aecc10edd9106ac'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:09.069018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 963/1940] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:08 2022] DELETE /identity/v3/users/23339b37c7b946449eb5e06a0504b0f9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:09.073686 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7828d-b884-43fc-93ef-7e78b82c501f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:09.074172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7828d-b884-43fc-93ef-7e78b82c501f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:09.074292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7828d-b884-43fc-93ef-7e78b82c501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:09.082724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cd467e0bfc47e98aecc10edd9106ac'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:09.083606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cd467e0bfc47e98aecc10edd9106ac'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:09.084440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cd467e0bfc47e98aecc10edd9106ac'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:09.094909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-55a87168-3ce7-4be3-82dd-11869e58a21e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cd467e0bfc47e98aecc10edd9106ac'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:09.107021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-dde7828d-b884-43fc-93ef-7e78b82c501f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:09.108287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-dde7828d-b884-43fc-93ef-7e78b82c501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:09.110410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 978/1941] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:08 2022] DELETE /identity/v3/users/a4cd467e0bfc47e98aecc10edd9106ac => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:09.114354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fa364-9fdb-40ba-a11a-f74174fa32ff None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:09.115050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fa364-9fdb-40ba-a11a-f74174fa32ff None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:09.115050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fa364-9fdb-40ba-a11a-f74174fa32ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:09.151554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6f0fa364-9fdb-40ba-a11a-f74174fa32ff None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:09.152755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6f0fa364-9fdb-40ba-a11a-f74174fa32ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:09.193426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 964/1942] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:09.206989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7828d-b884-43fc-93ef-7e78b82c501f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:09.208829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-dde7828d-b884-43fc-93ef-7e78b82c501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:09.244140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 979/1943] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:09.245001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fa364-9fdb-40ba-a11a-f74174fa32ff None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:09.247594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6f0fa364-9fdb-40ba-a11a-f74174fa32ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:09.320063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7828d-b884-43fc-93ef-7e78b82c501f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:09.324310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25369692-ff26-4766-a635-d6e89895578b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:09.324977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25369692-ff26-4766-a635-d6e89895578b service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:09.325264 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25369692-ff26-4766-a635-d6e89895578b service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:09.325540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25369692-ff26-4766-a635-d6e89895578b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:09.336966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25369692-ff26-4766-a635-d6e89895578b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:09.338640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25369692-ff26-4766-a635-d6e89895578b service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:09.339558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fa364-9fdb-40ba-a11a-f74174fa32ff None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:09.347271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfae81-d9c5-4151-a58a-f00fd5dd6e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:09.348354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfae81-d9c5-4151-a58a-f00fd5dd6e6f service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:09.348829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfae81-d9c5-4151-a58a-f00fd5dd6e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:09.350039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfae81-d9c5-4151-a58a-f00fd5dd6e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:09.355169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 965/1944] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:09.365736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfae81-d9c5-4151-a58a-f00fd5dd6e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:09.367311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfae81-d9c5-4151-a58a-f00fd5dd6e6f service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:09.394528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 980/1945] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:10.066887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25369692-ff26-4766-a635-d6e89895578b service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:10.068507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-25369692-ff26-4766-a635-d6e89895578b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:10.082256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25369692-ff26-4766-a635-d6e89895578b service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:10.095971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:10.097169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:10.097603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:10.097926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] PATH_INFO: `/v3/projects/1e66153339144990b2f1e154d5ee7f50` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:10.099288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e66153339144990b2f1e154d5ee7f50)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:10.101496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:10.114916 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfae81-d9c5-4151-a58a-f00fd5dd6e6f service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:10.116331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0cbfae81-d9c5-4151-a58a-f00fd5dd6e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:10.129336 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfae81-d9c5-4151-a58a-f00fd5dd6e6f service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:10.135193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:10.136343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:10.137309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:10.144691 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] PATH_INFO: `/v3/projects/caecd643fe7b46a98dcaa9d9f0de3ee1` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:10.146371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caecd643fe7b46a98dcaa9d9f0de3ee1)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:10.148686 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:10.169010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e66153339144990b2f1e154d5ee7f50', 'request_id': 'req-d45da756-22db-4aa7-b9f2-fda570591d03'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.175919 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e66153339144990b2f1e154d5ee7f50', 'request_id': 'req-d45da756-22db-4aa7-b9f2-fda570591d03'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.183365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e66153339144990b2f1e154d5ee7f50', 'request_id': 'req-d45da756-22db-4aa7-b9f2-fda570591d03'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.194383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] The token cache is being invalidate because project 1e66153339144990b2f1e154d5ee7f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:10.194695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.195373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.197278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 966/1946] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:10 2022] DELETE /identity/v3/projects/1e66153339144990b2f1e154d5ee7f50 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:10.198650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caecd643fe7b46a98dcaa9d9f0de3ee1', 'request_id': 'req-4465bef8-3142-48ac-b7c6-c6a07afdba39'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.201328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:10.202766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:10.205152 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caecd643fe7b46a98dcaa9d9f0de3ee1', 'request_id': 'req-4465bef8-3142-48ac-b7c6-c6a07afdba39'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.213114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caecd643fe7b46a98dcaa9d9f0de3ee1', 'request_id': 'req-4465bef8-3142-48ac-b7c6-c6a07afdba39'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.224355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] The token cache is being invalidate because project caecd643fe7b46a98dcaa9d9f0de3ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:10.224695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.225422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.227071 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 981/1947] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:10 2022] DELETE /identity/v3/projects/caecd643fe7b46a98dcaa9d9f0de3ee1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:10.231067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:10.232568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:10.272607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45da756-22db-4aa7-b9f2-fda570591d03 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:10.298642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465bef8-3142-48ac-b7c6-c6a07afdba39 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:10.304133 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:10.305055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:10.305334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:10.305655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] PATH_INFO: `/v3/users/f5f078b811a241a98dc3dc9730e35245` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:10.306937 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f078b811a241a98dc3dc9730e35245)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:10.308880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:10.326674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38678248-031f-4001-ac15-7db81220599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:10.327626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38678248-031f-4001-ac15-7db81220599c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:10.327908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38678248-031f-4001-ac15-7db81220599c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:10.328179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38678248-031f-4001-ac15-7db81220599c admin admin] PATH_INFO: `/v3/users/9946c7d583034b72a05eeebd0b493b70` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:10.329373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38678248-031f-4001-ac15-7db81220599c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9946c7d583034b72a05eeebd0b493b70)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:10.331509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38678248-031f-4001-ac15-7db81220599c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:10.360830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f078b811a241a98dc3dc9730e35245'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.373060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f078b811a241a98dc3dc9730e35245'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.374256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f078b811a241a98dc3dc9730e35245'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.374946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f078b811a241a98dc3dc9730e35245'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.384406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-38678248-031f-4001-ac15-7db81220599c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9946c7d583034b72a05eeebd0b493b70'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.385115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f078b811a241a98dc3dc9730e35245'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.399966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-38678248-031f-4001-ac15-7db81220599c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9946c7d583034b72a05eeebd0b493b70'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.400584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-38678248-031f-4001-ac15-7db81220599c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9946c7d583034b72a05eeebd0b493b70'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.404565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 982/1948] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:10 2022] DELETE /identity/v3/users/f5f078b811a241a98dc3dc9730e35245 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:10.411603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-38678248-031f-4001-ac15-7db81220599c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9946c7d583034b72a05eeebd0b493b70'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.412235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-38678248-031f-4001-ac15-7db81220599c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9946c7d583034b72a05eeebd0b493b70'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.430901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 967/1949] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:10 2022] DELETE /identity/v3/users/9946c7d583034b72a05eeebd0b493b70 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:10.534467 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:10.536766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:10.628155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0660a7-b3a4-47d2-aa29-39ede52b290b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:10.718075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:10.719234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:10.719517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:10.719787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] PATH_INFO: `/v3/users/29d2b6fb026f4825ba9655f5bb98b450` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:10.721042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d2b6fb026f4825ba9655f5bb98b450)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:10.723003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:10.801271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d2b6fb026f4825ba9655f5bb98b450'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.802528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38678248-031f-4001-ac15-7db81220599c admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:10.804038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-38678248-031f-4001-ac15-7db81220599c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:10.821675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38678248-031f-4001-ac15-7db81220599c admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:10.829990 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:10.831940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:10.833074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:10.833362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] PATH_INFO: `/v3/projects/09e831dc8bad4f03807a9d07b13b48a0` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:10.835268 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d2b6fb026f4825ba9655f5bb98b450'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.836315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e831dc8bad4f03807a9d07b13b48a0)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:10.837342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d2b6fb026f4825ba9655f5bb98b450'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.838752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d2b6fb026f4825ba9655f5bb98b450'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.844416 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:10.853056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d2b6fb026f4825ba9655f5bb98b450'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.879723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 983/1950] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:10 2022] DELETE /identity/v3/users/29d2b6fb026f4825ba9655f5bb98b450 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:10.880790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:10.883124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:10.911336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e831dc8bad4f03807a9d07b13b48a0', 'request_id': 'req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.921140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e831dc8bad4f03807a9d07b13b48a0', 'request_id': 'req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.934551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e831dc8bad4f03807a9d07b13b48a0', 'request_id': 'req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.947804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] The token cache is being invalidate because project 09e831dc8bad4f03807a9d07b13b48a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:10.948227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.949239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f55df8aa-0f49-4ba5-9b4f-288abd1f4c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:10.962962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 968/1951] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:10 2022] DELETE /identity/v3/projects/09e831dc8bad4f03807a9d07b13b48a0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:10.966121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b3070-a81f-4d4d-9c55-eb68a06f3ebc None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:10.966121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b3070-a81f-4d4d-9c55-eb68a06f3ebc None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:10.966121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b3070-a81f-4d4d-9c55-eb68a06f3ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:10.973130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628ef3-a5b5-4ca1-b5fe-4433b1b785c4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:11.001924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e53b3070-a81f-4d4d-9c55-eb68a06f3ebc None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:11.004757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e53b3070-a81f-4d4d-9c55-eb68a06f3ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:11.102659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:11.103823 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:11.104457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:11.104914 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] PATH_INFO: `/v3/projects/389c5e4b18684a629416e50310c7a86b` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:11.108240 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=389c5e4b18684a629416e50310c7a86b)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:11.112373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 969/1952] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:11.113710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbfc3f-e24a-4336-b190-396e72b37d14 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:11.114002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbfc3f-e24a-4336-b190-396e72b37d14 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:11.114323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbfc3f-e24a-4336-b190-396e72b37d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:11.114589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:11.172916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-61dbfc3f-e24a-4336-b190-396e72b37d14 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:11.175000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-61dbfc3f-e24a-4336-b190-396e72b37d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:11.193391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 970/1953] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:11.194286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbfc3f-e24a-4336-b190-396e72b37d14 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:11.195936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-61dbfc3f-e24a-4336-b190-396e72b37d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:11.238302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389c5e4b18684a629416e50310c7a86b', 'request_id': 'req-85dd2f96-fc85-461d-ac1e-1c6881013abf'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:11.247490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389c5e4b18684a629416e50310c7a86b', 'request_id': 'req-85dd2f96-fc85-461d-ac1e-1c6881013abf'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:11.261506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389c5e4b18684a629416e50310c7a86b', 'request_id': 'req-85dd2f96-fc85-461d-ac1e-1c6881013abf'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:11.281874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] The token cache is being invalidate because project 389c5e4b18684a629416e50310c7a86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:11.282214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:11.283090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-85dd2f96-fc85-461d-ac1e-1c6881013abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:11.288439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 984/1954] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:10 2022] DELETE /identity/v3/projects/389c5e4b18684a629416e50310c7a86b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:11.288439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb809d-0e70-4234-a87b-4ac0116c61b2 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:11.288439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb809d-0e70-4234-a87b-4ac0116c61b2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:11.288439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb809d-0e70-4234-a87b-4ac0116c61b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:11.303721 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbfc3f-e24a-4336-b190-396e72b37d14 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:11.322855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-72bb809d-0e70-4234-a87b-4ac0116c61b2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:11.324525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-72bb809d-0e70-4234-a87b-4ac0116c61b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:11.363770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655103dc-5b8a-4a98-b6ba-039caad76464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:11.364578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655103dc-5b8a-4a98-b6ba-039caad76464 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:11.365162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655103dc-5b8a-4a98-b6ba-039caad76464 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:11.365349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655103dc-5b8a-4a98-b6ba-039caad76464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:11.371793 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-655103dc-5b8a-4a98-b6ba-039caad76464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:11.390002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 985/1955] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:11.390953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb809d-0e70-4234-a87b-4ac0116c61b2 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:11.392221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-72bb809d-0e70-4234-a87b-4ac0116c61b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:11.404324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb809d-0e70-4234-a87b-4ac0116c61b2 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:11.409058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:11.409942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:11.410260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:11.410534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] PATH_INFO: `/v3/users/f2d539c6f0f442b796a4c779d51100a6` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:11.412195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d539c6f0f442b796a4c779d51100a6)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:11.414190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:11.455883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655103dc-5b8a-4a98-b6ba-039caad76464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:11.457561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655103dc-5b8a-4a98-b6ba-039caad76464 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:11.468179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d539c6f0f442b796a4c779d51100a6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:11.468495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 971/1956] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:11.471464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655103dc-5b8a-4a98-b6ba-039caad76464 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:11.485362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d539c6f0f442b796a4c779d51100a6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:11.486582 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d539c6f0f442b796a4c779d51100a6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:11.487207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655103dc-5b8a-4a98-b6ba-039caad76464 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:11.487349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d539c6f0f442b796a4c779d51100a6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:11.496654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beabd0a-3be9-49dd-9038-ccfe193b2c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:11.496976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d539c6f0f442b796a4c779d51100a6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:11.497464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beabd0a-3be9-49dd-9038-ccfe193b2c91 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:11.497695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beabd0a-3be9-49dd-9038-ccfe193b2c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:11.497995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beabd0a-3be9-49dd-9038-ccfe193b2c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:11.499488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beabd0a-3be9-49dd-9038-ccfe193b2c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:11.499864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beabd0a-3be9-49dd-9038-ccfe193b2c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:11.501930 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beabd0a-3be9-49dd-9038-ccfe193b2c91 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:11.518143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 986/1957] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:11 2022] DELETE /identity/v3/users/f2d539c6f0f442b796a4c779d51100a6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:11.523139 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 972/1958] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:11.529128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:11.531512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:11.627403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632301e7-16cc-47da-8fec-425276dacf1f admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:11.658881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b285688-ea1d-4a0b-a5b6-b93a4f30654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:11.668814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b285688-ea1d-4a0b-a5b6-b93a4f30654f admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:11.669040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b285688-ea1d-4a0b-a5b6-b93a4f30654f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:11.669320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b285688-ea1d-4a0b-a5b6-b93a4f30654f admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:11.671486 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b285688-ea1d-4a0b-a5b6-b93a4f30654f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:11.673449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b285688-ea1d-4a0b-a5b6-b93a4f30654f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:11.731450 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 987/1959] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:11 2022] POST /identity/v3/projects => generated 409 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:11.735631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beabd0a-3be9-49dd-9038-ccfe193b2c91 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:11.751164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beabd0a-3be9-49dd-9038-ccfe193b2c91 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:11.858936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78e26a-2e06-4e8d-9660-f88eee8acb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:11.860374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78e26a-2e06-4e8d-9660-f88eee8acb08 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:11.860665 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78e26a-2e06-4e8d-9660-f88eee8acb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:11.860946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78e26a-2e06-4e8d-9660-f88eee8acb08 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:11.861665 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78e26a-2e06-4e8d-9660-f88eee8acb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:11.862714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b285688-ea1d-4a0b-a5b6-b93a4f30654f admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:11.864287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78e26a-2e06-4e8d-9660-f88eee8acb08 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:11.864512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6b285688-ea1d-4a0b-a5b6-b93a4f30654f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:11.887394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b285688-ea1d-4a0b-a5b6-b93a4f30654f admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:11.897824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:11.902300 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:11.902604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:11.902863 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] PATH_INFO: `/v3/projects/2d6d637a00454e089942fe0a02204ab0` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:11.903413 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 973/1960] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:11 2022] POST /identity/v3/users => generated 305 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:11.905844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78e26a-2e06-4e8d-9660-f88eee8acb08 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:11.909797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6d637a00454e089942fe0a02204ab0)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:11.911991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:11.929788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78e26a-2e06-4e8d-9660-f88eee8acb08 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:11.939122 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30c10f-a384-4491-ad21-fe89b020dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:11.940230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c10f-a384-4491-ad21-fe89b020dc7b admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:11.940727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c10f-a384-4491-ad21-fe89b020dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:11.941160 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c10f-a384-4491-ad21-fe89b020dc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:11.942125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30c10f-a384-4491-ad21-fe89b020dc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:11.943781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30c10f-a384-4491-ad21-fe89b020dc7b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:11.958288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 974/1961] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:11.959382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30c10f-a384-4491-ad21-fe89b020dc7b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:11.973086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30c10f-a384-4491-ad21-fe89b020dc7b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:11.999278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6d637a00454e089942fe0a02204ab0', 'request_id': 'req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.017702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6d637a00454e089942fe0a02204ab0', 'request_id': 'req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.029299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6d637a00454e089942fe0a02204ab0', 'request_id': 'req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.041881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] The token cache is being invalidate because project 2d6d637a00454e089942fe0a02204ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:12.042261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.042963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.043850 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440ba24-e1e9-4402-ab48-4a9c28ee83e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.044631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ba24-e1e9-4402-ab48-4a9c28ee83e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.047804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 988/1962] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:11 2022] DELETE /identity/v3/projects/2d6d637a00454e089942fe0a02204ab0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:12.047948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ba24-e1e9-4402-ab48-4a9c28ee83e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.047948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ba24-e1e9-4402-ab48-4a9c28ee83e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.048083 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.048196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440ba24-e1e9-4402-ab48-4a9c28ee83e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.048273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.048712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440ba24-e1e9-4402-ab48-4a9c28ee83e3 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.059391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 975/1963] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:12.061188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440ba24-e1e9-4402-ab48-4a9c28ee83e3 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.063085 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b440ba24-e1e9-4402-ab48-4a9c28ee83e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.063898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ca3ed-b69d-4e7b-ac16-f3ebef5515fa admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.069958 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.071143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.071591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.071894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] PATH_INFO: `/v3/projects/46b4817c20d84ee892f02d2807236842` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.073278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b4817c20d84ee892f02d2807236842)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.075599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.077755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440ba24-e1e9-4402-ab48-4a9c28ee83e3 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.083346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.084321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.084686 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.085018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] PATH_INFO: `/v3/users/03b306976276458396439f0612b894d3` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.086613 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b306976276458396439f0612b894d3)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.088755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.137640 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b4817c20d84ee892f02d2807236842', 'request_id': 'req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.140871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b306976276458396439f0612b894d3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.143808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b4817c20d84ee892f02d2807236842', 'request_id': 'req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.151641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b4817c20d84ee892f02d2807236842', 'request_id': 'req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.152547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b306976276458396439f0612b894d3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.153345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b306976276458396439f0612b894d3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.160497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b306976276458396439f0612b894d3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.161683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d34d5143-d896-4a3a-8ea8-26a7484806ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b306976276458396439f0612b894d3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.162766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] The token cache is being invalidate because project 46b4817c20d84ee892f02d2807236842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:12.163052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.163682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.165247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 989/1964] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:12 2022] DELETE /identity/v3/projects/46b4817c20d84ee892f02d2807236842 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:12.166052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.169039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.174936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 976/1965] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:12 2022] DELETE /identity/v3/users/03b306976276458396439f0612b894d3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:12.176368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b7ca6-a0e6-481f-aded-0d5a523459e4 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.176653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b7ca6-a0e6-481f-aded-0d5a523459e4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.176928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b7ca6-a0e6-481f-aded-0d5a523459e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.197063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f98b7ca6-a0e6-481f-aded-0d5a523459e4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:12.198398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f98b7ca6-a0e6-481f-aded-0d5a523459e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.275288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcc0ec-dc5c-4f9a-bc19-4948a980c15a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.284482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 977/1966] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:12.294279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8f57-6b56-40a9-9ad5-6b231f705468 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.294615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8f57-6b56-40a9-9ad5-6b231f705468 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.294959 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8f57-6b56-40a9-9ad5-6b231f705468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.318231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-64cc8f57-6b56-40a9-9ad5-6b231f705468 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:12.320149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-64cc8f57-6b56-40a9-9ad5-6b231f705468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.334246 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 978/1967] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:12.335728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc8f57-6b56-40a9-9ad5-6b231f705468 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.354198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc8f57-6b56-40a9-9ad5-6b231f705468 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.374559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3c11-2421-4018-a8a0-ed5d8cfacc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.375402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3c11-2421-4018-a8a0-ed5d8cfacc29 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.375749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e7bd9-42e6-4e7f-9f58-6d8750460ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.376654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e7bd9-42e6-4e7f-9f58-6d8750460ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.376980 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e7bd9-42e6-4e7f-9f58-6d8750460ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.377304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e7bd9-42e6-4e7f-9f58-6d8750460ef1 admin admin] PATH_INFO: `/v3/projects/d1b7751a3baa4380be4667a1996daefe/users/45f67d5404a54666ac8fb9b03eef0b8a/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.378400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3c11-2421-4018-a8a0-ed5d8cfacc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.378764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3c11-2421-4018-a8a0-ed5d8cfacc29 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.379596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b3c11-2421-4018-a8a0-ed5d8cfacc29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:12.379975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b3c11-2421-4018-a8a0-ed5d8cfacc29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.381683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b3c11-2421-4018-a8a0-ed5d8cfacc29 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.397204 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e7bd9-42e6-4e7f-9f58-6d8750460ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b7751a3baa4380be4667a1996daefe, user_id=45f67d5404a54666ac8fb9b03eef0b8a, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.402888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e7bd9-42e6-4e7f-9f58-6d8750460ef1 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.405358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 979/1968] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:53:12.411415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3c11-2421-4018-a8a0-ed5d8cfacc29 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.428751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 990/1969] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:12 2022] PUT /identity/v3/projects/d1b7751a3baa4380be4667a1996daefe/users/45f67d5404a54666ac8fb9b03eef0b8a/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:12.432621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3c11-2421-4018-a8a0-ed5d8cfacc29 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.439182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f66e8d-b228-4e32-b4f5-e7d05f4bd26c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.439708 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f66e8d-b228-4e32-b4f5-e7d05f4bd26c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.440559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f66e8d-b228-4e32-b4f5-e7d05f4bd26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.487568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-37f66e8d-b228-4e32-b4f5-e7d05f4bd26c None None] MFA Rules not processed for user `45f67d5404a54666ac8fb9b03eef0b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:12.488856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-37f66e8d-b228-4e32-b4f5-e7d05f4bd26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.519965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd813a75-62dd-4c94-971a-7da66e751fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.520782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd813a75-62dd-4c94-971a-7da66e751fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.521161 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd813a75-62dd-4c94-971a-7da66e751fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.521568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd813a75-62dd-4c94-971a-7da66e751fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.522458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd813a75-62dd-4c94-971a-7da66e751fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.524627 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd813a75-62dd-4c94-971a-7da66e751fb5 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.565931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 980/1970] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:12 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:12.567269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd813a75-62dd-4c94-971a-7da66e751fb5 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.570366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cd813a75-62dd-4c94-971a-7da66e751fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.620755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 991/1971] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:12.621661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f66e8d-b228-4e32-b4f5-e7d05f4bd26c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.639066 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f66e8d-b228-4e32-b4f5-e7d05f4bd26c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.654360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd813a75-62dd-4c94-971a-7da66e751fb5 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.660126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.661383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.661659 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.661931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] PATH_INFO: `/v3/projects/528ad1c92bfc4c4d8dfcd10b7863d8a7` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.663156 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=528ad1c92bfc4c4d8dfcd10b7863d8a7)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.665107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.695311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef12073-db2d-4323-bb59-57e6e313f606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.696025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef12073-db2d-4323-bb59-57e6e313f606 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.696490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef12073-db2d-4323-bb59-57e6e313f606 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.696770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef12073-db2d-4323-bb59-57e6e313f606 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.697466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef12073-db2d-4323-bb59-57e6e313f606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.699578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef12073-db2d-4323-bb59-57e6e313f606 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.711070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528ad1c92bfc4c4d8dfcd10b7863d8a7', 'request_id': 'req-5f00daf0-c66c-4989-886b-d7214084e201'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.717959 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528ad1c92bfc4c4d8dfcd10b7863d8a7', 'request_id': 'req-5f00daf0-c66c-4989-886b-d7214084e201'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.723728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 992/1972] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:12 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:12.723728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef12073-db2d-4323-bb59-57e6e313f606 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.726281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528ad1c92bfc4c4d8dfcd10b7863d8a7', 'request_id': 'req-5f00daf0-c66c-4989-886b-d7214084e201'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.731859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef12073-db2d-4323-bb59-57e6e313f606 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.736338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] The token cache is being invalidate because project 528ad1c92bfc4c4d8dfcd10b7863d8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:12.736628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.737246 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:12.738780 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 981/1973] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:12 2022] DELETE /identity/v3/projects/528ad1c92bfc4c4d8dfcd10b7863d8a7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:12.739594 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.742933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.786994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697aba9-8521-435a-8401-cf7373f7c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.787664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697aba9-8521-435a-8401-cf7373f7c9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.787939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697aba9-8521-435a-8401-cf7373f7c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.788212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697aba9-8521-435a-8401-cf7373f7c9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.788908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697aba9-8521-435a-8401-cf7373f7c9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.790870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697aba9-8521-435a-8401-cf7373f7c9d6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.803890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00daf0-c66c-4989-886b-d7214084e201 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.809762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2a48a-035a-4f69-b02e-35aea21458fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.810522 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2a48a-035a-4f69-b02e-35aea21458fc admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.810885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2a48a-035a-4f69-b02e-35aea21458fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.811143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2a48a-035a-4f69-b02e-35aea21458fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.812028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2a48a-035a-4f69-b02e-35aea21458fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.813786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2a48a-035a-4f69-b02e-35aea21458fc admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.817864 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 993/1974] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:12 2022] POST /identity/v3/projects => generated 407 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:12.819216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9be0e4-7dbe-4069-ad9a-145e69d77362 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.819901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9be0e4-7dbe-4069-ad9a-145e69d77362 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.819901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9be0e4-7dbe-4069-ad9a-145e69d77362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.824949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 982/1975] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:12.825610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2a48a-035a-4f69-b02e-35aea21458fc admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.829362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c2c2a48a-035a-4f69-b02e-35aea21458fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.841432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2a48a-035a-4f69-b02e-35aea21458fc admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.841837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ff9be0e4-7dbe-4069-ad9a-145e69d77362 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:12.843076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ff9be0e4-7dbe-4069-ad9a-145e69d77362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.896095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f9ec1-a12f-4c00-a6aa-aa6693757e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.896776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9ec1-a12f-4c00-a6aa-aa6693757e2e admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.897061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9ec1-a12f-4c00-a6aa-aa6693757e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.897331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9ec1-a12f-4c00-a6aa-aa6693757e2e admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.898018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f9ec1-a12f-4c00-a6aa-aa6693757e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.899960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f9ec1-a12f-4c00-a6aa-aa6693757e2e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.902420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 994/1976] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:12.903394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9be0e4-7dbe-4069-ad9a-145e69d77362 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.919213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9be0e4-7dbe-4069-ad9a-145e69d77362 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.921600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 983/1977] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:12 2022] POST /identity/v3/users => generated 310 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:12.922864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f6ae2-f336-44ad-8ed6-48f46ae4578b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.923157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f6ae2-f336-44ad-8ed6-48f46ae4578b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.923433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f6ae2-f336-44ad-8ed6-48f46ae4578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.927030 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c537d3b-a5e2-406f-b6ac-526ed0467f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.927703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537d3b-a5e2-406f-b6ac-526ed0467f2c admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.928004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537d3b-a5e2-406f-b6ac-526ed0467f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.928245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537d3b-a5e2-406f-b6ac-526ed0467f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.929008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c537d3b-a5e2-406f-b6ac-526ed0467f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.930783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c537d3b-a5e2-406f-b6ac-526ed0467f2c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.940890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d75f6ae2-f336-44ad-8ed6-48f46ae4578b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:12.944724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 995/1978] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:12.944724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c537d3b-a5e2-406f-b6ac-526ed0467f2c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.944919 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d75f6ae2-f336-44ad-8ed6-48f46ae4578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:12.949962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 984/1979] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:12.950838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f6ae2-f336-44ad-8ed6-48f46ae4578b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.951716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c537d3b-a5e2-406f-b6ac-526ed0467f2c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.957626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dd357-015c-4511-a0af-4d06dc0588cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.958160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dd357-015c-4511-a0af-4d06dc0588cc admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.958443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dd357-015c-4511-a0af-4d06dc0588cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.958728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dd357-015c-4511-a0af-4d06dc0588cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.959442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dd357-015c-4511-a0af-4d06dc0588cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.961040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dd357-015c-4511-a0af-4d06dc0588cc admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.961295 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f6ae2-f336-44ad-8ed6-48f46ae4578b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.966524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1400d0-57f0-4183-8017-8bcc0e0db581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.967425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1400d0-57f0-4183-8017-8bcc0e0db581 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.967699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1400d0-57f0-4183-8017-8bcc0e0db581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.967974 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1400d0-57f0-4183-8017-8bcc0e0db581 admin admin] PATH_INFO: `/v3/projects/686a42bd51bb47d0a7796973c64ca8a4/users/b9f674ddf72f4967b482362755e5389a/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.975639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 996/1980] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:12.975639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dd357-015c-4511-a0af-4d06dc0588cc admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:12.983272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dd357-015c-4511-a0af-4d06dc0588cc admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:12.983899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1400d0-57f0-4183-8017-8bcc0e0db581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686a42bd51bb47d0a7796973c64ca8a4, user_id=b9f674ddf72f4967b482362755e5389a, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.986749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1400d0-57f0-4183-8017-8bcc0e0db581 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:12.988720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ac5ac-fc07-4309-a17d-e1a4101eb58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:12.989540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac5ac-fc07-4309-a17d-e1a4101eb58e admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:12.990243 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac5ac-fc07-4309-a17d-e1a4101eb58e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:12.990520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac5ac-fc07-4309-a17d-e1a4101eb58e admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:12.991451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ac5ac-fc07-4309-a17d-e1a4101eb58e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:12.991752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ac5ac-fc07-4309-a17d-e1a4101eb58e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:12.993574 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ac5ac-fc07-4309-a17d-e1a4101eb58e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.006184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 985/1981] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:12 2022] PUT /identity/v3/projects/686a42bd51bb47d0a7796973c64ca8a4/users/b9f674ddf72f4967b482362755e5389a/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:13.007221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1400d0-57f0-4183-8017-8bcc0e0db581 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.015926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 997/1982] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:13.020719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ddab5-ea9f-4abc-8d8a-f884e846d926 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.020992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ddab5-ea9f-4abc-8d8a-f884e846d926 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.021265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ddab5-ea9f-4abc-8d8a-f884e846d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.050246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d21ddab5-ea9f-4abc-8d8a-f884e846d926 None None] MFA Rules not processed for user `b9f674ddf72f4967b482362755e5389a`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:13.051453 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d21ddab5-ea9f-4abc-8d8a-f884e846d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:13.078860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1400d0-57f0-4183-8017-8bcc0e0db581 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.083766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220174de-26b2-4bc7-8ca1-42b9fb437247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.084671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220174de-26b2-4bc7-8ca1-42b9fb437247 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.084948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220174de-26b2-4bc7-8ca1-42b9fb437247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.085212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220174de-26b2-4bc7-8ca1-42b9fb437247 admin admin] PATH_INFO: `/v3/projects/badfea041d254c7690597e09abaa6e4c/users/13989c048f074e7db5561a1ee13f1385/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.100101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220174de-26b2-4bc7-8ca1-42b9fb437247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badfea041d254c7690597e09abaa6e4c, user_id=13989c048f074e7db5561a1ee13f1385, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.102836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220174de-26b2-4bc7-8ca1-42b9fb437247 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.114853 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 998/1983] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:13.115684 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ddab5-ea9f-4abc-8d8a-f884e846d926 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.116779 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 986/1984] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:13 2022] PUT /identity/v3/projects/badfea041d254c7690597e09abaa6e4c/users/13989c048f074e7db5561a1ee13f1385/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:13.122223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220174de-26b2-4bc7-8ca1-42b9fb437247 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.128325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ddab5-ea9f-4abc-8d8a-f884e846d926 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.183003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220174de-26b2-4bc7-8ca1-42b9fb437247 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.187917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1be2bb-7b8e-4d51-8ce9-502afcd91ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.188594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadac82-5bc8-40e6-9639-efa3835a8990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.189265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1be2bb-7b8e-4d51-8ce9-502afcd91ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.189374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadac82-5bc8-40e6-9639-efa3835a8990 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.189546 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1be2bb-7b8e-4d51-8ce9-502afcd91ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.189642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadac82-5bc8-40e6-9639-efa3835a8990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.189838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1be2bb-7b8e-4d51-8ce9-502afcd91ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.189938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadac82-5bc8-40e6-9639-efa3835a8990 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.190588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1be2bb-7b8e-4d51-8ce9-502afcd91ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.190682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadac82-5bc8-40e6-9639-efa3835a8990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.192210 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1be2bb-7b8e-4d51-8ce9-502afcd91ee0 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.192540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadac82-5bc8-40e6-9639-efa3835a8990 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.202391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 987/1985] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:13.202936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1be2bb-7b8e-4d51-8ce9-502afcd91ee0 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.212328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1be2bb-7b8e-4d51-8ce9-502afcd91ee0 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.216970 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce36064-4169-40d2-a961-9ad0833cd072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.217619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36064-4169-40d2-a961-9ad0833cd072 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.217980 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36064-4169-40d2-a961-9ad0833cd072 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.218276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36064-4169-40d2-a961-9ad0833cd072 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.218964 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce36064-4169-40d2-a961-9ad0833cd072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.220876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce36064-4169-40d2-a961-9ad0833cd072 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.221994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 999/1986] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:13 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:13.222906 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadac82-5bc8-40e6-9639-efa3835a8990 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.252096 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 988/1987] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:13 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:13.253142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce36064-4169-40d2-a961-9ad0833cd072 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.284978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadac82-5bc8-40e6-9639-efa3835a8990 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.312025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce36064-4169-40d2-a961-9ad0833cd072 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.317146 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6422f7-7e37-4305-aec0-73d9e5112a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.318208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6422f7-7e37-4305-aec0-73d9e5112a09 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.318491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6422f7-7e37-4305-aec0-73d9e5112a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.318940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6422f7-7e37-4305-aec0-73d9e5112a09 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.319634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6422f7-7e37-4305-aec0-73d9e5112a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.321651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6422f7-7e37-4305-aec0-73d9e5112a09 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.338400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929a415-df26-4004-a466-203b67bd2bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.339358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929a415-df26-4004-a466-203b67bd2bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.339694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929a415-df26-4004-a466-203b67bd2bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.339975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929a415-df26-4004-a466-203b67bd2bfb admin admin] PATH_INFO: `/v3/projects/badfea041d254c7690597e09abaa6e4c/users/13989c048f074e7db5561a1ee13f1385/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.341939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929a415-df26-4004-a466-203b67bd2bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=badfea041d254c7690597e09abaa6e4c, user_id=13989c048f074e7db5561a1ee13f1385, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.346927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 989/1988] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:13 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:13.346927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6422f7-7e37-4305-aec0-73d9e5112a09 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.347132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929a415-df26-4004-a466-203b67bd2bfb admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.354319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6422f7-7e37-4305-aec0-73d9e5112a09 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.355302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1000/1989] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:13 2022] PUT /identity/v3/projects/badfea041d254c7690597e09abaa6e4c/users/13989c048f074e7db5561a1ee13f1385/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:13.356105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929a415-df26-4004-a466-203b67bd2bfb admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.413730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f155d-c201-4340-8087-735af11648a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.414482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f155d-c201-4340-8087-735af11648a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.414726 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f155d-c201-4340-8087-735af11648a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.414993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f155d-c201-4340-8087-735af11648a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.415678 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f155d-c201-4340-8087-735af11648a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.417600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f155d-c201-4340-8087-735af11648a6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.419012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929a415-df26-4004-a466-203b67bd2bfb admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.423742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3fc1-bbbc-44fd-a2e5-0828abd9fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.424524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3fc1-bbbc-44fd-a2e5-0828abd9fe8d admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.424898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3fc1-bbbc-44fd-a2e5-0828abd9fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.425476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3fc1-bbbc-44fd-a2e5-0828abd9fe8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.426475 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f3fc1-bbbc-44fd-a2e5-0828abd9fe8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.428742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f3fc1-bbbc-44fd-a2e5-0828abd9fe8d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.438877 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 990/1990] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:13 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:13.440243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547170a-1613-42a7-9de9-a8c77ff07ba2 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.440530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547170a-1613-42a7-9de9-a8c77ff07ba2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.440804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547170a-1613-42a7-9de9-a8c77ff07ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.443180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1001/1991] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:13.446877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3fc1-bbbc-44fd-a2e5-0828abd9fe8d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.456708 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3fc1-bbbc-44fd-a2e5-0828abd9fe8d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.461647 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c4ebc-4992-44e8-8685-4d958d79187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.462658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c4ebc-4992-44e8-8685-4d958d79187b admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.462797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c4ebc-4992-44e8-8685-4d958d79187b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.463021 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c4ebc-4992-44e8-8685-4d958d79187b admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.463880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c4ebc-4992-44e8-8685-4d958d79187b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.465543 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c4ebc-4992-44e8-8685-4d958d79187b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.468587 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-7547170a-1613-42a7-9de9-a8c77ff07ba2 None None] MFA Rules not processed for user `13989c048f074e7db5561a1ee13f1385`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:13.469835 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7547170a-1613-42a7-9de9-a8c77ff07ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:13.476860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1002/1992] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:13.478327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c4ebc-4992-44e8-8685-4d958d79187b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.488478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c4ebc-4992-44e8-8685-4d958d79187b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.493249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46391d-5d42-4cf8-b786-6ea44f70cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.493968 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46391d-5d42-4cf8-b786-6ea44f70cac6 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.494278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46391d-5d42-4cf8-b786-6ea44f70cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.494557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46391d-5d42-4cf8-b786-6ea44f70cac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.495291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46391d-5d42-4cf8-b786-6ea44f70cac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.497156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46391d-5d42-4cf8-b786-6ea44f70cac6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.510464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1003/1993] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:13.510464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46391d-5d42-4cf8-b786-6ea44f70cac6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.520481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46391d-5d42-4cf8-b786-6ea44f70cac6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.526227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876d146-d1c6-4dbd-a870-162a3ac2ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.527126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876d146-d1c6-4dbd-a870-162a3ac2ed8b admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.527406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876d146-d1c6-4dbd-a870-162a3ac2ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.527686 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876d146-d1c6-4dbd-a870-162a3ac2ed8b admin admin] PATH_INFO: `/v3/projects/33fdace041e043d39d2adf78a9a1a076/users/e90c0fbd4a1f4ae69988977cb00b5be7/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.542854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876d146-d1c6-4dbd-a870-162a3ac2ed8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fdace041e043d39d2adf78a9a1a076, user_id=e90c0fbd4a1f4ae69988977cb00b5be7, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.545648 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876d146-d1c6-4dbd-a870-162a3ac2ed8b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.548512 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 991/1994] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:13 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:13.549369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547170a-1613-42a7-9de9-a8c77ff07ba2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.560270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547170a-1613-42a7-9de9-a8c77ff07ba2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.564694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1004/1995] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:13 2022] PUT /identity/v3/projects/33fdace041e043d39d2adf78a9a1a076/users/e90c0fbd4a1f4ae69988977cb00b5be7/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:13.568327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876d146-d1c6-4dbd-a870-162a3ac2ed8b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.570031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7876d146-d1c6-4dbd-a870-162a3ac2ed8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:13.625410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876d146-d1c6-4dbd-a870-162a3ac2ed8b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.628116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90911ce-440c-4f0e-bf86-7b362d435b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.629140 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90911ce-440c-4f0e-bf86-7b362d435b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.629261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7936-e511-4284-a6e9-876030ab2c6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.629545 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90911ce-440c-4f0e-bf86-7b362d435b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.629904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7936-e511-4284-a6e9-876030ab2c6d service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.630031 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90911ce-440c-4f0e-bf86-7b362d435b94 admin admin] PATH_INFO: `/v3/projects/1635b434a0064e54825039151a2dca05/users/870790dac7fc49a2a8d1e7a69cc0b2f8/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.630216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7936-e511-4284-a6e9-876030ab2c6d service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.630489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7936-e511-4284-a6e9-876030ab2c6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.657008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90911ce-440c-4f0e-bf86-7b362d435b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1635b434a0064e54825039151a2dca05, user_id=870790dac7fc49a2a8d1e7a69cc0b2f8, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.657008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90911ce-440c-4f0e-bf86-7b362d435b94 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.679237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 992/1996] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:13 2022] PUT /identity/v3/projects/1635b434a0064e54825039151a2dca05/users/870790dac7fc49a2a8d1e7a69cc0b2f8/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:13.680326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90911ce-440c-4f0e-bf86-7b362d435b94 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.705009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7936-e511-4284-a6e9-876030ab2c6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.706513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7936-e511-4284-a6e9-876030ab2c6d service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.716884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1005/1997] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:13 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:13.718073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcd71c-25fe-4642-8cf1-b03145967d97 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.718438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcd71c-25fe-4642-8cf1-b03145967d97 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.718723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcd71c-25fe-4642-8cf1-b03145967d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.751909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-7edcd71c-25fe-4642-8cf1-b03145967d97 None None] MFA Rules not processed for user `870790dac7fc49a2a8d1e7a69cc0b2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:13.753392 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7edcd71c-25fe-4642-8cf1-b03145967d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:13.799825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90911ce-440c-4f0e-bf86-7b362d435b94 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.805123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63f5bf-280b-49ce-8c0e-5017af127c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.806039 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63f5bf-280b-49ce-8c0e-5017af127c98 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.806354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63f5bf-280b-49ce-8c0e-5017af127c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.806631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63f5bf-280b-49ce-8c0e-5017af127c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.807376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63f5bf-280b-49ce-8c0e-5017af127c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.809041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63f5bf-280b-49ce-8c0e-5017af127c98 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.821798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 993/1998] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:13.826999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63f5bf-280b-49ce-8c0e-5017af127c98 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.846383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1006/1999] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:13.847703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63f5bf-280b-49ce-8c0e-5017af127c98 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.851165 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcd71c-25fe-4642-8cf1-b03145967d97 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:13.856077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509e184-8f3d-4cc6-9fd1-6d067b56d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.857256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509e184-8f3d-4cc6-9fd1-6d067b56d0da admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.857531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509e184-8f3d-4cc6-9fd1-6d067b56d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.857801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509e184-8f3d-4cc6-9fd1-6d067b56d0da admin admin] PATH_INFO: `/v3/projects/33fdace041e043d39d2adf78a9a1a076/users/e90c0fbd4a1f4ae69988977cb00b5be7/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.860023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509e184-8f3d-4cc6-9fd1-6d067b56d0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fdace041e043d39d2adf78a9a1a076, user_id=e90c0fbd4a1f4ae69988977cb00b5be7, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.862736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509e184-8f3d-4cc6-9fd1-6d067b56d0da admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.872113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcd71c-25fe-4642-8cf1-b03145967d97 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:13.882302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 994/2000] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:13 2022] PUT /identity/v3/projects/33fdace041e043d39d2adf78a9a1a076/users/e90c0fbd4a1f4ae69988977cb00b5be7/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:13.897279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b88ce-8f18-4a0b-a562-ec1d2b779952 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.897660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b88ce-8f18-4a0b-a562-ec1d2b779952 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.897877 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b88ce-8f18-4a0b-a562-ec1d2b779952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.940043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0a3b88ce-8f18-4a0b-a562-ec1d2b779952 None None] MFA Rules not processed for user `e90c0fbd4a1f4ae69988977cb00b5be7`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:13.941234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0a3b88ce-8f18-4a0b-a562-ec1d2b779952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:13.945397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d5379-0c0e-49d9-8150-30586eafa80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:13.946137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5379-0c0e-49d9-8150-30586eafa80b admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:13.946464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5379-0c0e-49d9-8150-30586eafa80b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:13.946745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5379-0c0e-49d9-8150-30586eafa80b admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:13.947586 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d5379-0c0e-49d9-8150-30586eafa80b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:13.949588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d5379-0c0e-49d9-8150-30586eafa80b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:13.982095 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1007/2001] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:13 2022] POST /identity/v3/projects => generated 389 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:13.983079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d5379-0c0e-49d9-8150-30586eafa80b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.018459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 995/2002] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:14.022271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b88ce-8f18-4a0b-a562-ec1d2b779952 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.031945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b88ce-8f18-4a0b-a562-ec1d2b779952 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.059766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d5379-0c0e-49d9-8150-30586eafa80b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.063838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af76f31-dd0b-4dbc-9595-704c2ce7954a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.064499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af76f31-dd0b-4dbc-9595-704c2ce7954a service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.064770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af76f31-dd0b-4dbc-9595-704c2ce7954a service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.065046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af76f31-dd0b-4dbc-9595-704c2ce7954a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.066917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8af76f31-dd0b-4dbc-9595-704c2ce7954a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:14.098046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aa2ec-717d-465f-8365-1ff3e63cf080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.098933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa2ec-717d-465f-8365-1ff3e63cf080 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.099218 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa2ec-717d-465f-8365-1ff3e63cf080 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.099496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa2ec-717d-465f-8365-1ff3e63cf080 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.100190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141aa2ec-717d-465f-8365-1ff3e63cf080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.102146 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141aa2ec-717d-465f-8365-1ff3e63cf080 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:14.122783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 996/2003] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:14 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:14.126748 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af76f31-dd0b-4dbc-9595-704c2ce7954a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.126973 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aa2ec-717d-465f-8365-1ff3e63cf080 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.128202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af76f31-dd0b-4dbc-9595-704c2ce7954a service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:14.128754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-141aa2ec-717d-465f-8365-1ff3e63cf080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:14.137251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1008/2004] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:14.138140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af76f31-dd0b-4dbc-9595-704c2ce7954a service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.140007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aa2ec-717d-465f-8365-1ff3e63cf080 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.144299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504d21-ed1e-493d-bb4d-4082a3cdf5a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.145000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504d21-ed1e-493d-bb4d-4082a3cdf5a1 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.145348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504d21-ed1e-493d-bb4d-4082a3cdf5a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.145677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504d21-ed1e-493d-bb4d-4082a3cdf5a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.150129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af76f31-dd0b-4dbc-9595-704c2ce7954a service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.154885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf0592-2ffb-48d2-912f-9abfed69efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.155693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf0592-2ffb-48d2-912f-9abfed69efaa admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.156131 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf0592-2ffb-48d2-912f-9abfed69efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.156395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf0592-2ffb-48d2-912f-9abfed69efaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.157204 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf0592-2ffb-48d2-912f-9abfed69efaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.158938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf0592-2ffb-48d2-912f-9abfed69efaa admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:14.170030 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1009/2005] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:14.174116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf0592-2ffb-48d2-912f-9abfed69efaa admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.184001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf0592-2ffb-48d2-912f-9abfed69efaa admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.189350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c96eb-3753-4ac9-881f-4d2fd15e8604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.190487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c96eb-3753-4ac9-881f-4d2fd15e8604 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.190770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c96eb-3753-4ac9-881f-4d2fd15e8604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.191044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c96eb-3753-4ac9-881f-4d2fd15e8604 admin admin] PATH_INFO: `/v3/projects/103827173ba14919a26579d9de77e862/users/45db956760f245f0974bb03bc06b1ffa/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.206921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c96eb-3753-4ac9-881f-4d2fd15e8604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103827173ba14919a26579d9de77e862, user_id=45db956760f245f0974bb03bc06b1ffa, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.209618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c96eb-3753-4ac9-881f-4d2fd15e8604 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:14.212970 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504d21-ed1e-493d-bb4d-4082a3cdf5a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.214517 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504d21-ed1e-493d-bb4d-4082a3cdf5a1 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:14.223541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1010/2006] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:14 2022] PUT /identity/v3/projects/103827173ba14919a26579d9de77e862/users/45db956760f245f0974bb03bc06b1ffa/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:14.227190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 997/2007] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:14.227526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c96eb-3753-4ac9-881f-4d2fd15e8604 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.294825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c96eb-3753-4ac9-881f-4d2fd15e8604 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.299985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98808286-ef79-432b-9865-02df6cc5d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.300821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98808286-ef79-432b-9865-02df6cc5d843 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.301150 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98808286-ef79-432b-9865-02df6cc5d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.301490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98808286-ef79-432b-9865-02df6cc5d843 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.302335 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98808286-ef79-432b-9865-02df6cc5d843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.304135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98808286-ef79-432b-9865-02df6cc5d843 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:14.315464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1011/2008] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:14.319769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504d21-ed1e-493d-bb4d-4082a3cdf5a1 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.331820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504d21-ed1e-493d-bb4d-4082a3cdf5a1 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.336678 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111eb20a-7be7-47ac-9c46-3555af4941e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.337577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eb20a-7be7-47ac-9c46-3555af4941e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.337855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eb20a-7be7-47ac-9c46-3555af4941e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.338165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eb20a-7be7-47ac-9c46-3555af4941e9 admin admin] PATH_INFO: `/v3/projects/103827173ba14919a26579d9de77e862/users/45db956760f245f0974bb03bc06b1ffa/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.340914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111eb20a-7be7-47ac-9c46-3555af4941e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103827173ba14919a26579d9de77e862, user_id=45db956760f245f0974bb03bc06b1ffa, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.344090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111eb20a-7be7-47ac-9c46-3555af4941e9 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:14.365717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 998/2009] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:14 2022] PUT /identity/v3/projects/103827173ba14919a26579d9de77e862/users/45db956760f245f0974bb03bc06b1ffa/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:14.367800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f23a-e442-49a9-b2e2-f78720a5b146 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.368093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f23a-e442-49a9-b2e2-f78720a5b146 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.368370 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f23a-e442-49a9-b2e2-f78720a5b146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.415520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2df8f23a-e442-49a9-b2e2-f78720a5b146 None None] MFA Rules not processed for user `45db956760f245f0974bb03bc06b1ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:14.416963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2df8f23a-e442-49a9-b2e2-f78720a5b146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:14.461102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111eb20a-7be7-47ac-9c46-3555af4941e9 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.516929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1012/2010] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:14.528716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f23a-e442-49a9-b2e2-f78720a5b146 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.541929 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111eb20a-7be7-47ac-9c46-3555af4941e9 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.546731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba465893-aae7-4951-a947-9aed98080710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.547506 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba465893-aae7-4951-a947-9aed98080710 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.547793 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba465893-aae7-4951-a947-9aed98080710 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.548067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba465893-aae7-4951-a947-9aed98080710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.592491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f23a-e442-49a9-b2e2-f78720a5b146 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.598762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234cc59-c9e4-4893-8bfc-23a2b9e9da5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.599934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234cc59-c9e4-4893-8bfc-23a2b9e9da5b service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.600323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234cc59-c9e4-4893-8bfc-23a2b9e9da5b service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.600606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234cc59-c9e4-4893-8bfc-23a2b9e9da5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.613390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234cc59-c9e4-4893-8bfc-23a2b9e9da5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.614689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba465893-aae7-4951-a947-9aed98080710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.615468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234cc59-c9e4-4893-8bfc-23a2b9e9da5b service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:14.616216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba465893-aae7-4951-a947-9aed98080710 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:14.627056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1013/2011] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:14.627574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 999/2012] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:14.660292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a04e8f-eb0f-4c78-b99c-91688a2d32ac None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.660638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a04e8f-eb0f-4c78-b99c-91688a2d32ac None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.661237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a04e8f-eb0f-4c78-b99c-91688a2d32ac None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.663326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1014/2013] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:53:14.677650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cafc1-4b60-4eae-b9b6-26f170303408 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.678035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cafc1-4b60-4eae-b9b6-26f170303408 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.678433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cafc1-4b60-4eae-b9b6-26f170303408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.705674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-cc0cafc1-4b60-4eae-b9b6-26f170303408 None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:14.707019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cc0cafc1-4b60-4eae-b9b6-26f170303408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:14.823860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1000/2014] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:53:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:14.841172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a04e8f-eb0f-4c78-b99c-91688a2d32ac None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.843209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cafc1-4b60-4eae-b9b6-26f170303408 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:14.843815 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-56a04e8f-eb0f-4c78-b99c-91688a2d32ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:14.883045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a04e8f-eb0f-4c78-b99c-91688a2d32ac None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.898675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b007e6-46c7-4df3-a48a-3020b2985b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.900285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b007e6-46c7-4df3-a48a-3020b2985b38 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.900285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b007e6-46c7-4df3-a48a-3020b2985b38 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.900285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b007e6-46c7-4df3-a48a-3020b2985b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.914923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b007e6-46c7-4df3-a48a-3020b2985b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.916868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b007e6-46c7-4df3-a48a-3020b2985b38 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:14.939621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1015/2015] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:14.957490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cafc1-4b60-4eae-b9b6-26f170303408 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:14.970938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:14.971875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:14.972180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:14.972454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] PATH_INFO: `/v3/users/870790dac7fc49a2a8d1e7a69cc0b2f8` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:14.974453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=870790dac7fc49a2a8d1e7a69cc0b2f8)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:14.978102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:15.053288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870790dac7fc49a2a8d1e7a69cc0b2f8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.070155 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870790dac7fc49a2a8d1e7a69cc0b2f8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.071027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870790dac7fc49a2a8d1e7a69cc0b2f8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.080390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870790dac7fc49a2a8d1e7a69cc0b2f8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.081025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870790dac7fc49a2a8d1e7a69cc0b2f8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.105384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1001/2016] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:14 2022] DELETE /identity/v3/users/870790dac7fc49a2a8d1e7a69cc0b2f8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:15.109865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafd1c7-a06b-4700-88ad-0a1e92eef755 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:15.110184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafd1c7-a06b-4700-88ad-0a1e92eef755 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:15.110460 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafd1c7-a06b-4700-88ad-0a1e92eef755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:15.128593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-feafd1c7-a06b-4700-88ad-0a1e92eef755 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:15.129785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-feafd1c7-a06b-4700-88ad-0a1e92eef755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:15.186455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1016/2017] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:15.196447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:15.198284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:15.254214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d7a28-aa03-42ba-bb2f-b68ddb4fb9fb admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:15.257722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb364f-e40f-4057-901a-870c4f02883b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:15.258429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb364f-e40f-4057-901a-870c4f02883b service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:15.258719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb364f-e40f-4057-901a-870c4f02883b service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:15.258995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb364f-e40f-4057-901a-870c4f02883b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:15.268367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb364f-e40f-4057-901a-870c4f02883b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:15.269827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb364f-e40f-4057-901a-870c4f02883b service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:15.279019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1002/2018] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:15.554098 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafd1c7-a06b-4700-88ad-0a1e92eef755 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:15.555605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-feafd1c7-a06b-4700-88ad-0a1e92eef755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:15.567803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafd1c7-a06b-4700-88ad-0a1e92eef755 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:15.572662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:15.573643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:15.574017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:15.574347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] PATH_INFO: `/v3/projects/1635b434a0064e54825039151a2dca05` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:15.575930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1635b434a0064e54825039151a2dca05)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:15.578319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:15.624929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1635b434a0064e54825039151a2dca05', 'request_id': 'req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.630771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1635b434a0064e54825039151a2dca05', 'request_id': 'req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.642777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1635b434a0064e54825039151a2dca05', 'request_id': 'req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.653057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] The token cache is being invalidate because project 1635b434a0064e54825039151a2dca05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:15.653340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.653959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.655655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1017/2019] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:15 2022] DELETE /identity/v3/projects/1635b434a0064e54825039151a2dca05 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:15.660072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb364f-e40f-4057-901a-870c4f02883b service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:15.670403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb364f-e40f-4057-901a-870c4f02883b service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:15.729045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:15.729845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:15.730129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:15.730417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] PATH_INFO: `/v3/users/45db956760f245f0974bb03bc06b1ffa` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:15.731624 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=45db956760f245f0974bb03bc06b1ffa)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:15.733541 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:15.780897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45db956760f245f0974bb03bc06b1ffa'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.792626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45db956760f245f0974bb03bc06b1ffa'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.793296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45db956760f245f0974bb03bc06b1ffa'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.801257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45db956760f245f0974bb03bc06b1ffa'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.801931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d9eef5f5-7a3f-4907-8be5-3d00806451cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45db956760f245f0974bb03bc06b1ffa'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:15.814490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1003/2020] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:15 2022] DELETE /identity/v3/users/45db956760f245f0974bb03bc06b1ffa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:16.088822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:16.090467 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:16.117044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3810e-500d-4255-8688-2bbd9c7fb9f4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:16.179516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:16.180398 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.180678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.180951 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] PATH_INFO: `/v3/projects/103827173ba14919a26579d9de77e862` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.182364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103827173ba14919a26579d9de77e862)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:16.184305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:16.229661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103827173ba14919a26579d9de77e862', 'request_id': 'req-4886a961-6613-4628-9c4d-aaa41977c9f5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:16.235821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103827173ba14919a26579d9de77e862', 'request_id': 'req-4886a961-6613-4628-9c4d-aaa41977c9f5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:16.244887 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103827173ba14919a26579d9de77e862', 'request_id': 'req-4886a961-6613-4628-9c4d-aaa41977c9f5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:16.255295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] The token cache is being invalidate because project 103827173ba14919a26579d9de77e862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:16.255593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:16.256227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4886a961-6613-4628-9c4d-aaa41977c9f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:16.257875 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1018/2021] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:16 2022] DELETE /identity/v3/projects/103827173ba14919a26579d9de77e862 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:16.262827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635524ef-1413-4315-b3a4-0c8061245edf None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.263272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635524ef-1413-4315-b3a4-0c8061245edf None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.263360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635524ef-1413-4315-b3a4-0c8061245edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.281331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-635524ef-1413-4315-b3a4-0c8061245edf None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:16.282782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-635524ef-1413-4315-b3a4-0c8061245edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:16.346236 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1004/2022] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:16.354308 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a6a43-e078-434c-9cde-02190f69b669 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.354597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a6a43-e078-434c-9cde-02190f69b669 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.355091 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a6a43-e078-434c-9cde-02190f69b669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.376633 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6c7a6a43-e078-434c-9cde-02190f69b669 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:16.377901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6c7a6a43-e078-434c-9cde-02190f69b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:16.390532 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1019/2023] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:16.391078 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635524ef-1413-4315-b3a4-0c8061245edf None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:16.402419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635524ef-1413-4315-b3a4-0c8061245edf None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:16.408316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1376-39a7-4f77-bcd2-b22ff4cb32c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:16.409085 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1376-39a7-4f77-bcd2-b22ff4cb32c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.409377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1376-39a7-4f77-bcd2-b22ff4cb32c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.409641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1376-39a7-4f77-bcd2-b22ff4cb32c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.419411 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef1376-39a7-4f77-bcd2-b22ff4cb32c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:16.419737 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef1376-39a7-4f77-bcd2-b22ff4cb32c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:16.421440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef1376-39a7-4f77-bcd2-b22ff4cb32c5 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:16.450258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1005/2024] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:53:16.452965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a6a43-e078-434c-9cde-02190f69b669 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:16.473081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a6a43-e078-434c-9cde-02190f69b669 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:16.478607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d69f7-312f-434c-91a0-fb70c8db18d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:16.479356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d69f7-312f-434c-91a0-fb70c8db18d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.479702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d69f7-312f-434c-91a0-fb70c8db18d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.480044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d69f7-312f-434c-91a0-fb70c8db18d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.480810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d69f7-312f-434c-91a0-fb70c8db18d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:16.482841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d69f7-312f-434c-91a0-fb70c8db18d6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:16.516944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1020/2025] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:16 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:16.518276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1376-39a7-4f77-bcd2-b22ff4cb32c5 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:16.528253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1376-39a7-4f77-bcd2-b22ff4cb32c5 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:16.588578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4038e-ebfe-4d6e-968f-02827cfd7b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:16.589287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4038e-ebfe-4d6e-968f-02827cfd7b4d admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.589538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4038e-ebfe-4d6e-968f-02827cfd7b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.589814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4038e-ebfe-4d6e-968f-02827cfd7b4d admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.590709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4038e-ebfe-4d6e-968f-02827cfd7b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:16.603044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4038e-ebfe-4d6e-968f-02827cfd7b4d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:16.614632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1006/2026] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:16 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:16.618969 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d69f7-312f-434c-91a0-fb70c8db18d6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:16.628833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d69f7-312f-434c-91a0-fb70c8db18d6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:16.633506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff88df-cae6-4e31-a781-24cdbd46cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:16.634258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff88df-cae6-4e31-a781-24cdbd46cb72 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.634545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff88df-cae6-4e31-a781-24cdbd46cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.634822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff88df-cae6-4e31-a781-24cdbd46cb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.635549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff88df-cae6-4e31-a781-24cdbd46cb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:16.637218 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff88df-cae6-4e31-a781-24cdbd46cb72 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:16.648046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1021/2027] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:16.652331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4038e-ebfe-4d6e-968f-02827cfd7b4d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:16.663088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4038e-ebfe-4d6e-968f-02827cfd7b4d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:16.668361 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f78180-e5ac-4695-a708-cb9acd615ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:16.669043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78180-e5ac-4695-a708-cb9acd615ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.669370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78180-e5ac-4695-a708-cb9acd615ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.669648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78180-e5ac-4695-a708-cb9acd615ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.670415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f78180-e5ac-4695-a708-cb9acd615ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:16.672211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f78180-e5ac-4695-a708-cb9acd615ea8 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:16.685198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1007/2028] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:16.686592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff88df-cae6-4e31-a781-24cdbd46cb72 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:16.696858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff88df-cae6-4e31-a781-24cdbd46cb72 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:16.701523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cc6b-4bf5-4d89-8789-ff5d8d68b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:16.702757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cc6b-4bf5-4d89-8789-ff5d8d68b5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.703092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cc6b-4bf5-4d89-8789-ff5d8d68b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.703371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cc6b-4bf5-4d89-8789-ff5d8d68b5cf admin admin] PATH_INFO: `/v3/projects/b31bf633aa754e098b213caed75d86a6/users/ec26142fd60f4414b7d4f325f1191750/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.719202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26cc6b-4bf5-4d89-8789-ff5d8d68b5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31bf633aa754e098b213caed75d86a6, user_id=ec26142fd60f4414b7d4f325f1191750, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:16.721850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26cc6b-4bf5-4d89-8789-ff5d8d68b5cf admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:16.735600 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1022/2029] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:16 2022] PUT /identity/v3/projects/b31bf633aa754e098b213caed75d86a6/users/ec26142fd60f4414b7d4f325f1191750/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:16.745813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33674a3-765e-41c5-bfc2-f87ac938f18b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.746127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33674a3-765e-41c5-bfc2-f87ac938f18b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.746486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33674a3-765e-41c5-bfc2-f87ac938f18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.773214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f33674a3-765e-41c5-bfc2-f87ac938f18b None None] MFA Rules not processed for user `ec26142fd60f4414b7d4f325f1191750`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:16.774458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f33674a3-765e-41c5-bfc2-f87ac938f18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:16.839456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1008/2030] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:16.844334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cc6b-4bf5-4d89-8789-ff5d8d68b5cf admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:16.908279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cc6b-4bf5-4d89-8789-ff5d8d68b5cf admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:16.913581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65e340-5253-47ac-9191-c3e3ef7c8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:16.914296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65e340-5253-47ac-9191-c3e3ef7c8329 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:16.914603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65e340-5253-47ac-9191-c3e3ef7c8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:16.914876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65e340-5253-47ac-9191-c3e3ef7c8329 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:16.915576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65e340-5253-47ac-9191-c3e3ef7c8329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:16.917631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65e340-5253-47ac-9191-c3e3ef7c8329 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:16.945038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1023/2031] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:16 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:16.949362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33674a3-765e-41c5-bfc2-f87ac938f18b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:16.960478 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33674a3-765e-41c5-bfc2-f87ac938f18b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:17.016400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26b29c-65a7-485b-86aa-dd3530f1aa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:17.017086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26b29c-65a7-485b-86aa-dd3530f1aa27 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:17.017342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26b29c-65a7-485b-86aa-dd3530f1aa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:17.017615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26b29c-65a7-485b-86aa-dd3530f1aa27 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:17.018334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26b29c-65a7-485b-86aa-dd3530f1aa27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:17.020292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26b29c-65a7-485b-86aa-dd3530f1aa27 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:17.050016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1009/2032] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:16 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:17.051455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65e340-5253-47ac-9191-c3e3ef7c8329 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:17.063544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65e340-5253-47ac-9191-c3e3ef7c8329 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:17.068801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ecd4c-7c6d-4245-a7bf-de90fc7b0550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:17.069472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ecd4c-7c6d-4245-a7bf-de90fc7b0550 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:17.069746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ecd4c-7c6d-4245-a7bf-de90fc7b0550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:17.070041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ecd4c-7c6d-4245-a7bf-de90fc7b0550 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:17.070850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ecd4c-7c6d-4245-a7bf-de90fc7b0550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:17.072457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ecd4c-7c6d-4245-a7bf-de90fc7b0550 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:17.082998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1024/2033] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:17.087328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26b29c-65a7-485b-86aa-dd3530f1aa27 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:17.098115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26b29c-65a7-485b-86aa-dd3530f1aa27 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:17.102875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80e50-e718-42e7-b188-5232b7236e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:17.103765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80e50-e718-42e7-b188-5232b7236e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:17.104035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80e50-e718-42e7-b188-5232b7236e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:17.104303 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80e50-e718-42e7-b188-5232b7236e54 admin admin] PATH_INFO: `/v3/projects/f160b58f472c49649106a7c56e5cc702/users/6e07577068aa4accbc725737bdc9e38e/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:17.119500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a80e50-e718-42e7-b188-5232b7236e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f160b58f472c49649106a7c56e5cc702, user_id=6e07577068aa4accbc725737bdc9e38e, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:17.122302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a80e50-e718-42e7-b188-5232b7236e54 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:17.137675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1010/2034] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:17 2022] PUT /identity/v3/projects/f160b58f472c49649106a7c56e5cc702/users/6e07577068aa4accbc725737bdc9e38e/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:17.141799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ecd4c-7c6d-4245-a7bf-de90fc7b0550 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:17.151754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ecd4c-7c6d-4245-a7bf-de90fc7b0550 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:17.212284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421913cd-43b6-498b-b648-33a606f73a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:17.213237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421913cd-43b6-498b-b648-33a606f73a48 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:17.213683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421913cd-43b6-498b-b648-33a606f73a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:17.213940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421913cd-43b6-498b-b648-33a606f73a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:17.214717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421913cd-43b6-498b-b648-33a606f73a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:17.216683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421913cd-43b6-498b-b648-33a606f73a48 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:17.232374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1025/2035] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:17.235927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80e50-e718-42e7-b188-5232b7236e54 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:17.249963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80e50-e718-42e7-b188-5232b7236e54 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:17.255441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b95c7d-0bac-49e6-ab81-5548b21306bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:17.256474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b95c7d-0bac-49e6-ab81-5548b21306bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:17.256848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b95c7d-0bac-49e6-ab81-5548b21306bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:17.257195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b95c7d-0bac-49e6-ab81-5548b21306bc admin admin] PATH_INFO: `/v3/projects/f160b58f472c49649106a7c56e5cc702/users/6e07577068aa4accbc725737bdc9e38e/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:17.259360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b95c7d-0bac-49e6-ab81-5548b21306bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f160b58f472c49649106a7c56e5cc702, user_id=6e07577068aa4accbc725737bdc9e38e, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:17.262203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b95c7d-0bac-49e6-ab81-5548b21306bc admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:17.273928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1011/2036] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:17 2022] PUT /identity/v3/projects/f160b58f472c49649106a7c56e5cc702/users/6e07577068aa4accbc725737bdc9e38e/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:17.284111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba25b94-8d21-4b67-94b7-6a3761f0e6fa None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:17.284601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba25b94-8d21-4b67-94b7-6a3761f0e6fa None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:17.284876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba25b94-8d21-4b67-94b7-6a3761f0e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:17.336697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0ba25b94-8d21-4b67-94b7-6a3761f0e6fa None None] MFA Rules not processed for user `6e07577068aa4accbc725737bdc9e38e`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:17.338290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0ba25b94-8d21-4b67-94b7-6a3761f0e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:17.433248 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1026/2037] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:17.445029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b95c7d-0bac-49e6-ab81-5548b21306bc admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:17.447957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a8b95c7d-0bac-49e6-ab81-5548b21306bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:17.542821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b95c7d-0bac-49e6-ab81-5548b21306bc admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:17.547615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d7810-a6ab-4a8e-9702-7e0a9569c6fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:17.548574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7810-a6ab-4a8e-9702-7e0a9569c6fa service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:17.548860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7810-a6ab-4a8e-9702-7e0a9569c6fa service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:17.549526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7810-a6ab-4a8e-9702-7e0a9569c6fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:17.563852 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d7810-a6ab-4a8e-9702-7e0a9569c6fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:17.565359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d7810-a6ab-4a8e-9702-7e0a9569c6fa service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:17.589329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1012/2038] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:17.719598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba25b94-8d21-4b67-94b7-6a3761f0e6fa None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:17.729601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba25b94-8d21-4b67-94b7-6a3761f0e6fa None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:17.734824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5a1ca-0c5b-4f60-92b2-269a6e49307a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:17.735806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a1ca-0c5b-4f60-92b2-269a6e49307a service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:17.736286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a1ca-0c5b-4f60-92b2-269a6e49307a service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:17.736696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a1ca-0c5b-4f60-92b2-269a6e49307a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:17.820616 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5a1ca-0c5b-4f60-92b2-269a6e49307a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:17.823989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5a1ca-0c5b-4f60-92b2-269a6e49307a service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:17.849656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1027/2039] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:18.113121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d7810-a6ab-4a8e-9702-7e0a9569c6fa service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:18.174250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d7810-a6ab-4a8e-9702-7e0a9569c6fa service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:18.180224 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:18.181138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:18.181423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:18.181698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] PATH_INFO: `/v3/users/ec26142fd60f4414b7d4f325f1191750` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:18.183169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec26142fd60f4414b7d4f325f1191750)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:18.185142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:18.243379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec26142fd60f4414b7d4f325f1191750'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:18.255892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec26142fd60f4414b7d4f325f1191750'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:18.256595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec26142fd60f4414b7d4f325f1191750'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:18.265639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec26142fd60f4414b7d4f325f1191750'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:18.266304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec26142fd60f4414b7d4f325f1191750'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:18.278639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1013/2040] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:18 2022] DELETE /identity/v3/users/ec26142fd60f4414b7d4f325f1191750 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:18.283180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe59d-60eb-4b38-b66d-b87e85e8a3cd None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:18.283497 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe59d-60eb-4b38-b66d-b87e85e8a3cd None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:18.283768 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe59d-60eb-4b38-b66d-b87e85e8a3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:18.302308 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-557fe59d-60eb-4b38-b66d-b87e85e8a3cd None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:18.303621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-557fe59d-60eb-4b38-b66d-b87e85e8a3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:18.362808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1028/2041] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:18.389497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:18.391311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:18.451739 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a42dae-6c61-4292-957b-824486ef8a90 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:18.456334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173e53-654a-4fde-bd54-c79da83fe194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:18.456991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173e53-654a-4fde-bd54-c79da83fe194 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:18.457276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173e53-654a-4fde-bd54-c79da83fe194 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:18.457552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173e53-654a-4fde-bd54-c79da83fe194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:18.468559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa173e53-654a-4fde-bd54-c79da83fe194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:18.470118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa173e53-654a-4fde-bd54-c79da83fe194 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:18.484896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1014/2042] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:18.868316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fe59d-60eb-4b38-b66d-b87e85e8a3cd None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:18.870323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-557fe59d-60eb-4b38-b66d-b87e85e8a3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:18.882589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fe59d-60eb-4b38-b66d-b87e85e8a3cd None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:18.888323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:18.889439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:18.889836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:18.890139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] PATH_INFO: `/v3/projects/b31bf633aa754e098b213caed75d86a6` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:18.891521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31bf633aa754e098b213caed75d86a6)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:18.893734 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:18.943307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31bf633aa754e098b213caed75d86a6', 'request_id': 'req-69ea2be2-3618-4bbe-bb89-8d625c7b703c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:18.949727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31bf633aa754e098b213caed75d86a6', 'request_id': 'req-69ea2be2-3618-4bbe-bb89-8d625c7b703c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:18.957879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31bf633aa754e098b213caed75d86a6', 'request_id': 'req-69ea2be2-3618-4bbe-bb89-8d625c7b703c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:18.969170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] The token cache is being invalidate because project b31bf633aa754e098b213caed75d86a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:18.969460 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:18.970177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:18.971755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1029/2043] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:18 2022] DELETE /identity/v3/projects/b31bf633aa754e098b213caed75d86a6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:18.975890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173e53-654a-4fde-bd54-c79da83fe194 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:18.985378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173e53-654a-4fde-bd54-c79da83fe194 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:19.045866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:19.046856 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:19.047154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:19.047432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] PATH_INFO: `/v3/users/6e07577068aa4accbc725737bdc9e38e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:19.048927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e07577068aa4accbc725737bdc9e38e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:19.052414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:19.102978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e07577068aa4accbc725737bdc9e38e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:19.116565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e07577068aa4accbc725737bdc9e38e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:19.117241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e07577068aa4accbc725737bdc9e38e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:19.125130 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e07577068aa4accbc725737bdc9e38e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:19.125757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-885b33ad-f7bf-403c-bea5-9b7a8f4b5254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e07577068aa4accbc725737bdc9e38e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:19.138345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1015/2044] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:18 2022] DELETE /identity/v3/users/6e07577068aa4accbc725737bdc9e38e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:19.409162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:19.411148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:19.426426 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea2be2-3618-4bbe-bb89-8d625c7b703c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:19.484381 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:19.485369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:19.485715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:19.486060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] PATH_INFO: `/v3/projects/f160b58f472c49649106a7c56e5cc702` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:19.487556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f160b58f472c49649106a7c56e5cc702)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:19.489623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:19.539416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f160b58f472c49649106a7c56e5cc702', 'request_id': 'req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:19.545778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f160b58f472c49649106a7c56e5cc702', 'request_id': 'req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:19.554708 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f160b58f472c49649106a7c56e5cc702', 'request_id': 'req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:19.564878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] The token cache is being invalidate because project f160b58f472c49649106a7c56e5cc702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:19.565180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:19.565822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-59a499a3-9e9e-49ba-ae0d-c0afc6a50de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:19.567454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1030/2045] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:19 2022] DELETE /identity/v3/projects/f160b58f472c49649106a7c56e5cc702 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:19.573564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a804b-159b-4650-8cc6-8446fa0b1eb5 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:19.574056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a804b-159b-4650-8cc6-8446fa0b1eb5 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:19.574941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a804b-159b-4650-8cc6-8446fa0b1eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:19.594364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-7f5a804b-159b-4650-8cc6-8446fa0b1eb5 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:19.596002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7f5a804b-159b-4650-8cc6-8446fa0b1eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:19.659434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1016/2046] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:19.668698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441262-31f9-4595-a506-5fb0cbd60fb2 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:19.668992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441262-31f9-4595-a506-5fb0cbd60fb2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:19.669272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441262-31f9-4595-a506-5fb0cbd60fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:19.688003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-69441262-31f9-4595-a506-5fb0cbd60fb2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:19.689224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-69441262-31f9-4595-a506-5fb0cbd60fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:19.699399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1031/2047] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:19.701937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a804b-159b-4650-8cc6-8446fa0b1eb5 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:19.712211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a804b-159b-4650-8cc6-8446fa0b1eb5 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:19.731370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f317f2-c688-4840-9098-62c5b25e4f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:19.732101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f317f2-c688-4840-9098-62c5b25e4f08 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:19.732385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f317f2-c688-4840-9098-62c5b25e4f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:19.732630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f317f2-c688-4840-9098-62c5b25e4f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:19.733399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f317f2-c688-4840-9098-62c5b25e4f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:19.733755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f317f2-c688-4840-9098-62c5b25e4f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:19.735403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f317f2-c688-4840-9098-62c5b25e4f08 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:19.757028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1017/2048] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:19.758271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441262-31f9-4595-a506-5fb0cbd60fb2 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:19.767345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441262-31f9-4595-a506-5fb0cbd60fb2 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:19.771895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377faadc-ba3f-438a-a1f8-2b627ddecdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:19.772542 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377faadc-ba3f-438a-a1f8-2b627ddecdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:19.772825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377faadc-ba3f-438a-a1f8-2b627ddecdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:19.773090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377faadc-ba3f-438a-a1f8-2b627ddecdf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:19.773780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377faadc-ba3f-438a-a1f8-2b627ddecdf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:19.775927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377faadc-ba3f-438a-a1f8-2b627ddecdf4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:19.803043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1032/2049] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:19 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:19.807462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f317f2-c688-4840-9098-62c5b25e4f08 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:19.818187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f317f2-c688-4840-9098-62c5b25e4f08 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:19.872629 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a462dad-3fb8-46ef-b588-b237a922b212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:19.873664 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462dad-3fb8-46ef-b588-b237a922b212 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:19.873664 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462dad-3fb8-46ef-b588-b237a922b212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:19.874058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462dad-3fb8-46ef-b588-b237a922b212 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:19.874898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a462dad-3fb8-46ef-b588-b237a922b212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:19.877211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a462dad-3fb8-46ef-b588-b237a922b212 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:19.898385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1018/2050] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:19 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:19.902679 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377faadc-ba3f-438a-a1f8-2b627ddecdf4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:19.914004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377faadc-ba3f-438a-a1f8-2b627ddecdf4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:19.919150 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172979e4-f4fe-40a8-b4b2-1cdf289ee2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:19.919931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172979e4-f4fe-40a8-b4b2-1cdf289ee2dd admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:19.920342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172979e4-f4fe-40a8-b4b2-1cdf289ee2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:19.920614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172979e4-f4fe-40a8-b4b2-1cdf289ee2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:19.921516 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172979e4-f4fe-40a8-b4b2-1cdf289ee2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:19.923314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172979e4-f4fe-40a8-b4b2-1cdf289ee2dd admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:19.934585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1033/2051] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:19.938666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a462dad-3fb8-46ef-b588-b237a922b212 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:19.948959 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a462dad-3fb8-46ef-b588-b237a922b212 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:19.953782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ddbc5-10f9-4327-882e-5ac87c82c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:19.954494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ddbc5-10f9-4327-882e-5ac87c82c7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:19.954794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ddbc5-10f9-4327-882e-5ac87c82c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:19.955053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ddbc5-10f9-4327-882e-5ac87c82c7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:19.955780 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ddbc5-10f9-4327-882e-5ac87c82c7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:19.957483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ddbc5-10f9-4327-882e-5ac87c82c7e0 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:19.967613 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1019/2052] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:19.971966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172979e4-f4fe-40a8-b4b2-1cdf289ee2dd admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:19.982043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172979e4-f4fe-40a8-b4b2-1cdf289ee2dd admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:19.987114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07125-89be-4261-b21c-e50a482b05d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:19.988006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07125-89be-4261-b21c-e50a482b05d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:19.988327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07125-89be-4261-b21c-e50a482b05d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:19.988601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07125-89be-4261-b21c-e50a482b05d2 admin admin] PATH_INFO: `/v3/projects/1927b06de67f459398bed7592dea43fd/users/be8c2f084592458397d507e599887002/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.003307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca07125-89be-4261-b21c-e50a482b05d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1927b06de67f459398bed7592dea43fd, user_id=be8c2f084592458397d507e599887002, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:20.005983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca07125-89be-4261-b21c-e50a482b05d2 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:20.021104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1034/2053] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:19 2022] PUT /identity/v3/projects/1927b06de67f459398bed7592dea43fd/users/be8c2f084592458397d507e599887002/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:20.031501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bf616-8163-4be4-a6fc-cf6dbd8f6a25 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.031792 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bf616-8163-4be4-a6fc-cf6dbd8f6a25 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.032074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bf616-8163-4be4-a6fc-cf6dbd8f6a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.058386 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-419bf616-8163-4be4-a6fc-cf6dbd8f6a25 None None] MFA Rules not processed for user `be8c2f084592458397d507e599887002`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:20.059591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-419bf616-8163-4be4-a6fc-cf6dbd8f6a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:20.147315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1020/2054] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:20.152159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07125-89be-4261-b21c-e50a482b05d2 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:20.213363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07125-89be-4261-b21c-e50a482b05d2 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:20.218148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ddc37-f288-41cd-9943-957d9c608513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:20.218803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ddc37-f288-41cd-9943-957d9c608513 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.219084 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ddc37-f288-41cd-9943-957d9c608513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.219414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ddc37-f288-41cd-9943-957d9c608513 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.220107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ddc37-f288-41cd-9943-957d9c608513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:20.222045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ddc37-f288-41cd-9943-957d9c608513 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:20.248515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1035/2055] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:20 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:20.252868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bf616-8163-4be4-a6fc-cf6dbd8f6a25 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:20.263755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bf616-8163-4be4-a6fc-cf6dbd8f6a25 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:20.320722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a1fe4-da27-422f-8c4b-6900e39bd4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:20.321396 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a1fe4-da27-422f-8c4b-6900e39bd4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.321688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a1fe4-da27-422f-8c4b-6900e39bd4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.321965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a1fe4-da27-422f-8c4b-6900e39bd4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.322696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a1fe4-da27-422f-8c4b-6900e39bd4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:20.324644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a1fe4-da27-422f-8c4b-6900e39bd4b6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:20.345841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1021/2056] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:20 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:20.349823 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ddc37-f288-41cd-9943-957d9c608513 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:20.360441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ddc37-f288-41cd-9943-957d9c608513 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:20.365676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dffe18-cbbc-43df-a74f-cdbf25743c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:20.366404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dffe18-cbbc-43df-a74f-cdbf25743c0b admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.366832 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dffe18-cbbc-43df-a74f-cdbf25743c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.367121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dffe18-cbbc-43df-a74f-cdbf25743c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.367865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dffe18-cbbc-43df-a74f-cdbf25743c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:20.369461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dffe18-cbbc-43df-a74f-cdbf25743c0b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:20.380482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1036/2057] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:20.384461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a1fe4-da27-422f-8c4b-6900e39bd4b6 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:20.394489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a1fe4-da27-422f-8c4b-6900e39bd4b6 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:20.399727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70f091-cb5c-4de2-9395-4b137552a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:20.400384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70f091-cb5c-4de2-9395-4b137552a169 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.400661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70f091-cb5c-4de2-9395-4b137552a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.400937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70f091-cb5c-4de2-9395-4b137552a169 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.401663 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70f091-cb5c-4de2-9395-4b137552a169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:20.403371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70f091-cb5c-4de2-9395-4b137552a169 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:20.413810 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1022/2058] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:20.419027 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dffe18-cbbc-43df-a74f-cdbf25743c0b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:20.429250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dffe18-cbbc-43df-a74f-cdbf25743c0b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:20.435106 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3859eb7-216f-47e1-bf9b-8c0acea2ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:20.436043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3859eb7-216f-47e1-bf9b-8c0acea2ea46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.436325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3859eb7-216f-47e1-bf9b-8c0acea2ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.436642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3859eb7-216f-47e1-bf9b-8c0acea2ea46 admin admin] PATH_INFO: `/v3/projects/2edddd3f3c62492ab3f2eb7715bd848f/users/2ece96e25ef94ba0a96ab5c5f28106fa/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.452640 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3859eb7-216f-47e1-bf9b-8c0acea2ea46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edddd3f3c62492ab3f2eb7715bd848f, user_id=2ece96e25ef94ba0a96ab5c5f28106fa, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:20.455494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3859eb7-216f-47e1-bf9b-8c0acea2ea46 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:20.469485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1037/2059] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:20 2022] PUT /identity/v3/projects/2edddd3f3c62492ab3f2eb7715bd848f/users/2ece96e25ef94ba0a96ab5c5f28106fa/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:20.479999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7c3d-b96b-4d92-8ce5-39173a9e10d7 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.480256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7c3d-b96b-4d92-8ce5-39173a9e10d7 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.480541 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7c3d-b96b-4d92-8ce5-39173a9e10d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.508820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-6b2d7c3d-b96b-4d92-8ce5-39173a9e10d7 None None] MFA Rules not processed for user `2ece96e25ef94ba0a96ab5c5f28106fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:20.509605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6b2d7c3d-b96b-4d92-8ce5-39173a9e10d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:20.586686 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1023/2060] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:20.592208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3859eb7-216f-47e1-bf9b-8c0acea2ea46 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:20.655520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3859eb7-216f-47e1-bf9b-8c0acea2ea46 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:20.660437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b76c01-ce4e-47a9-8677-b3a9bc9e242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:20.661456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b76c01-ce4e-47a9-8677-b3a9bc9e242f admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.661745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b76c01-ce4e-47a9-8677-b3a9bc9e242f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.662020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b76c01-ce4e-47a9-8677-b3a9bc9e242f admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.662755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b76c01-ce4e-47a9-8677-b3a9bc9e242f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:20.664676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b76c01-ce4e-47a9-8677-b3a9bc9e242f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:20.692026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1038/2061] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:20 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:20.696349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7c3d-b96b-4d92-8ce5-39173a9e10d7 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:20.708071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7c3d-b96b-4d92-8ce5-39173a9e10d7 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:20.776971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a4437-f6f4-4a0a-bfbc-6e8ad8eeb06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:20.777921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4437-f6f4-4a0a-bfbc-6e8ad8eeb06f admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.779638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4437-f6f4-4a0a-bfbc-6e8ad8eeb06f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.779638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4437-f6f4-4a0a-bfbc-6e8ad8eeb06f admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.779638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a4437-f6f4-4a0a-bfbc-6e8ad8eeb06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:20.781523 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a4437-f6f4-4a0a-bfbc-6e8ad8eeb06f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:20.815666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1024/2062] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:20 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:20.820400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b76c01-ce4e-47a9-8677-b3a9bc9e242f admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:20.834357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b76c01-ce4e-47a9-8677-b3a9bc9e242f admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:20.847489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a598-71c8-4cec-90ae-2da7552038ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:20.849712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a598-71c8-4cec-90ae-2da7552038ac admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.850847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a598-71c8-4cec-90ae-2da7552038ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.851069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a598-71c8-4cec-90ae-2da7552038ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.853236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853a598-71c8-4cec-90ae-2da7552038ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:20.859191 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853a598-71c8-4cec-90ae-2da7552038ac admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:20.873386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1039/2063] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:20.882423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a4437-f6f4-4a0a-bfbc-6e8ad8eeb06f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:20.894240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a4437-f6f4-4a0a-bfbc-6e8ad8eeb06f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:20.900480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8a123-317c-47b9-8980-6bfd122ab096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:20.902229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a123-317c-47b9-8980-6bfd122ab096 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:20.902725 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a123-317c-47b9-8980-6bfd122ab096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:20.903147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a123-317c-47b9-8980-6bfd122ab096 admin admin] PATH_INFO: `/v3/projects/b5c75cd1ee1e43f0b000aa54cd8fa395/users/fc654b9cd97b4e42ab9f74251c4a20b3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:20.921131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8a123-317c-47b9-8980-6bfd122ab096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c75cd1ee1e43f0b000aa54cd8fa395, user_id=fc654b9cd97b4e42ab9f74251c4a20b3, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:20.924171 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8a123-317c-47b9-8980-6bfd122ab096 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:20.938784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1025/2064] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:20 2022] PUT /identity/v3/projects/b5c75cd1ee1e43f0b000aa54cd8fa395/users/fc654b9cd97b4e42ab9f74251c4a20b3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:20.943577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a598-71c8-4cec-90ae-2da7552038ac admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:20.962775 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a598-71c8-4cec-90ae-2da7552038ac admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:21.030462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa55abe-980f-45a0-828a-4152a5119f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:21.031375 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa55abe-980f-45a0-828a-4152a5119f17 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:21.031768 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa55abe-980f-45a0-828a-4152a5119f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:21.032155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa55abe-980f-45a0-828a-4152a5119f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:21.032985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa55abe-980f-45a0-828a-4152a5119f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:21.034694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa55abe-980f-45a0-828a-4152a5119f17 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:21.046614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1040/2065] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:21.050972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8a123-317c-47b9-8980-6bfd122ab096 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:21.063294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8a123-317c-47b9-8980-6bfd122ab096 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:21.071077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db7f74-58d1-4c8a-9db8-fbfc13abe390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:21.072282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db7f74-58d1-4c8a-9db8-fbfc13abe390 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:21.074061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db7f74-58d1-4c8a-9db8-fbfc13abe390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:21.076164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db7f74-58d1-4c8a-9db8-fbfc13abe390 admin admin] PATH_INFO: `/v3/projects/b5c75cd1ee1e43f0b000aa54cd8fa395/users/fc654b9cd97b4e42ab9f74251c4a20b3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:21.080963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db7f74-58d1-4c8a-9db8-fbfc13abe390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c75cd1ee1e43f0b000aa54cd8fa395, user_id=fc654b9cd97b4e42ab9f74251c4a20b3, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:21.084485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db7f74-58d1-4c8a-9db8-fbfc13abe390 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:21.098255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1026/2066] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:21 2022] PUT /identity/v3/projects/b5c75cd1ee1e43f0b000aa54cd8fa395/users/fc654b9cd97b4e42ab9f74251c4a20b3/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:21.110819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31053-b385-47f3-b5fb-035b455394cb None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:21.111140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31053-b385-47f3-b5fb-035b455394cb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:21.111387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31053-b385-47f3-b5fb-035b455394cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:21.188196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-5db31053-b385-47f3-b5fb-035b455394cb None None] MFA Rules not processed for user `fc654b9cd97b4e42ab9f74251c4a20b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:21.192007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5db31053-b385-47f3-b5fb-035b455394cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:21.276406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1041/2067] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:21.288523 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db7f74-58d1-4c8a-9db8-fbfc13abe390 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:21.290259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b1db7f74-58d1-4c8a-9db8-fbfc13abe390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:21.361605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db7f74-58d1-4c8a-9db8-fbfc13abe390 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:21.365214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39db3fd-2538-42d4-8cee-cb43aa1e7f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:21.365870 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db3fd-2538-42d4-8cee-cb43aa1e7f40 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:21.366184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db3fd-2538-42d4-8cee-cb43aa1e7f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:21.366463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db3fd-2538-42d4-8cee-cb43aa1e7f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:21.426613 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39db3fd-2538-42d4-8cee-cb43aa1e7f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:21.428077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39db3fd-2538-42d4-8cee-cb43aa1e7f40 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:21.442162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1027/2068] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:24.789787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31053-b385-47f3-b5fb-035b455394cb None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:24.791786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5db31053-b385-47f3-b5fb-035b455394cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:24.874594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31053-b385-47f3-b5fb-035b455394cb None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:24.880321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:24.881484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:24.881833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:24.897656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] PATH_INFO: `/v3/users/b9f674ddf72f4967b482362755e5389a` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:24.897656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f674ddf72f4967b482362755e5389a)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:24.897656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:24.955631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f674ddf72f4967b482362755e5389a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:24.976452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f674ddf72f4967b482362755e5389a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:24.977586 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f674ddf72f4967b482362755e5389a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:24.978488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f674ddf72f4967b482362755e5389a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:24.987580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f674ddf72f4967b482362755e5389a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.004747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1042/2069] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:24 2022] DELETE /identity/v3/users/b9f674ddf72f4967b482362755e5389a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:25.009832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a993e-f8c7-46d7-a5a9-5ea4d7e9451a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:25.010733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a993e-f8c7-46d7-a5a9-5ea4d7e9451a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:25.011168 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a993e-f8c7-46d7-a5a9-5ea4d7e9451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:25.045557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-9f4a993e-f8c7-46d7-a5a9-5ea4d7e9451a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:25.047527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9f4a993e-f8c7-46d7-a5a9-5ea4d7e9451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:25.089694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:25.091299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:25.124415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1028/2070] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:25.135303 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a993e-f8c7-46d7-a5a9-5ea4d7e9451a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:25.137153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9f4a993e-f8c7-46d7-a5a9-5ea4d7e9451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:25.164626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2cc7-abaf-455d-a726-97cffca16daf admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:25.169088 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f973d-9d77-4c26-b4e6-94785ff51aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:25.169731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f973d-9d77-4c26-b4e6-94785ff51aca service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:25.170158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f973d-9d77-4c26-b4e6-94785ff51aca service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:25.171297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f973d-9d77-4c26-b4e6-94785ff51aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:25.172801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-862f973d-9d77-4c26-b4e6-94785ff51aca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:25.198657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a993e-f8c7-46d7-a5a9-5ea4d7e9451a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:25.202547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a6e79-ea60-44ba-92a3-5271f2685a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:25.203266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a6e79-ea60-44ba-92a3-5271f2685a33 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:25.203544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a6e79-ea60-44ba-92a3-5271f2685a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:25.203939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a6e79-ea60-44ba-92a3-5271f2685a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:25.214600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a6e79-ea60-44ba-92a3-5271f2685a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:25.216241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a6e79-ea60-44ba-92a3-5271f2685a33 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:25.226611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1029/2071] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:25.234889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f973d-9d77-4c26-b4e6-94785ff51aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:25.237079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f973d-9d77-4c26-b4e6-94785ff51aca service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:25.246645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1043/2072] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:25.525188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a6e79-ea60-44ba-92a3-5271f2685a33 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:25.525516 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c60a6e79-ea60-44ba-92a3-5271f2685a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:25.542126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a6e79-ea60-44ba-92a3-5271f2685a33 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:25.548194 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:25.549214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:25.549630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:25.549989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] PATH_INFO: `/v3/projects/686a42bd51bb47d0a7796973c64ca8a4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:25.551315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] RBAC: Authorizing `identity:delete_project(project_id=686a42bd51bb47d0a7796973c64ca8a4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:25.553487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:25.639996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686a42bd51bb47d0a7796973c64ca8a4', 'request_id': 'req-3b25080f-299b-4c4d-9136-98e8671e048b'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.647317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686a42bd51bb47d0a7796973c64ca8a4', 'request_id': 'req-3b25080f-299b-4c4d-9136-98e8671e048b'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.659665 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686a42bd51bb47d0a7796973c64ca8a4', 'request_id': 'req-3b25080f-299b-4c4d-9136-98e8671e048b'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.676915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] The token cache is being invalidate because project 686a42bd51bb47d0a7796973c64ca8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:25.677300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.678824 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.679954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1030/2073] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:25 2022] DELETE /identity/v3/projects/686a42bd51bb47d0a7796973c64ca8a4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:25.687689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f973d-9d77-4c26-b4e6-94785ff51aca service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:25.704214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f973d-9d77-4c26-b4e6-94785ff51aca service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:25.794196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:25.796507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:25.796954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:25.797425 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] PATH_INFO: `/v3/users/e90c0fbd4a1f4ae69988977cb00b5be7` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:25.800072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90c0fbd4a1f4ae69988977cb00b5be7)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:25.802695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:25.910006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90c0fbd4a1f4ae69988977cb00b5be7'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.924603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90c0fbd4a1f4ae69988977cb00b5be7'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.925411 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90c0fbd4a1f4ae69988977cb00b5be7'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.926014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90c0fbd4a1f4ae69988977cb00b5be7'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.936442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90c0fbd4a1f4ae69988977cb00b5be7'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:25.953642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1044/2074] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:25 2022] DELETE /identity/v3/users/e90c0fbd4a1f4ae69988977cb00b5be7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:26.247078 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:26.248833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:26.312819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25080f-299b-4c4d-9136-98e8671e048b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:26.368314 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b752852-9e7c-4349-a05b-29d27a9e6c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:26.368999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752852-9e7c-4349-a05b-29d27a9e6c69 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:26.369452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752852-9e7c-4349-a05b-29d27a9e6c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:26.369736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752852-9e7c-4349-a05b-29d27a9e6c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:26.372261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1b752852-9e7c-4349-a05b-29d27a9e6c69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:26.443776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b752852-9e7c-4349-a05b-29d27a9e6c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:26.445298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b752852-9e7c-4349-a05b-29d27a9e6c69 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:26.456597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1031/2075] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:26.492778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:26.494279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:26.602157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f545-c228-4de2-a69d-0721a903bca8 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:26.608205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:26.609212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:26.609484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:26.609750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] PATH_INFO: `/v3/projects/33fdace041e043d39d2adf78a9a1a076` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:26.610969 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fdace041e043d39d2adf78a9a1a076)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:26.613099 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:26.667797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fdace041e043d39d2adf78a9a1a076', 'request_id': 'req-40c00fbb-521d-4df1-ba72-1747c57271f5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:26.674324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fdace041e043d39d2adf78a9a1a076', 'request_id': 'req-40c00fbb-521d-4df1-ba72-1747c57271f5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:26.685369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fdace041e043d39d2adf78a9a1a076', 'request_id': 'req-40c00fbb-521d-4df1-ba72-1747c57271f5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:26.696224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] The token cache is being invalidate because project 33fdace041e043d39d2adf78a9a1a076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:26.696505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:26.697130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-40c00fbb-521d-4df1-ba72-1747c57271f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:26.699669 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1045/2076] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:26 2022] DELETE /identity/v3/projects/33fdace041e043d39d2adf78a9a1a076 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:26.703913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d09f72-c8b0-4757-a1d2-3ed2ba50ec01 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:26.704240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d09f72-c8b0-4757-a1d2-3ed2ba50ec01 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:26.704522 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d09f72-c8b0-4757-a1d2-3ed2ba50ec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:26.723583 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-18d09f72-c8b0-4757-a1d2-3ed2ba50ec01 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:26.724798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-18d09f72-c8b0-4757-a1d2-3ed2ba50ec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:26.789584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1032/2077] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:26.799086 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893ef3-0da1-4a2d-a5d9-2ad68c01d1d4 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:26.799676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893ef3-0da1-4a2d-a5d9-2ad68c01d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:26.799676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893ef3-0da1-4a2d-a5d9-2ad68c01d1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:26.822652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-81893ef3-0da1-4a2d-a5d9-2ad68c01d1d4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:26.823943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-81893ef3-0da1-4a2d-a5d9-2ad68c01d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:26.832288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1046/2078] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:26.836726 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d09f72-c8b0-4757-a1d2-3ed2ba50ec01 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:26.846963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d09f72-c8b0-4757-a1d2-3ed2ba50ec01 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:26.852278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c17aa6-8237-4f50-977d-18f6435ff23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:26.852886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c17aa6-8237-4f50-977d-18f6435ff23f admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:26.853168 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c17aa6-8237-4f50-977d-18f6435ff23f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:26.853444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c17aa6-8237-4f50-977d-18f6435ff23f admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:26.854203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c17aa6-8237-4f50-977d-18f6435ff23f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:26.854733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c17aa6-8237-4f50-977d-18f6435ff23f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:26.856363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c17aa6-8237-4f50-977d-18f6435ff23f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:26.870131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1033/2079] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:26.873329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893ef3-0da1-4a2d-a5d9-2ad68c01d1d4 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:26.883490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893ef3-0da1-4a2d-a5d9-2ad68c01d1d4 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:26.888195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb7e91-387b-49ea-bf56-9599defd2a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:26.888983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb7e91-387b-49ea-bf56-9599defd2a8d admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:26.889421 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb7e91-387b-49ea-bf56-9599defd2a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:26.889747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb7e91-387b-49ea-bf56-9599defd2a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:26.890455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb7e91-387b-49ea-bf56-9599defd2a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:26.892356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb7e91-387b-49ea-bf56-9599defd2a8d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:26.920932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1047/2080] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:26 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:26.925143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c17aa6-8237-4f50-977d-18f6435ff23f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:26.935563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c17aa6-8237-4f50-977d-18f6435ff23f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:26.994511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d810ee-b430-4acc-b26c-f10d05e7782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:26.995197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d810ee-b430-4acc-b26c-f10d05e7782e admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:26.995480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d810ee-b430-4acc-b26c-f10d05e7782e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:26.995755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d810ee-b430-4acc-b26c-f10d05e7782e admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:26.996466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d810ee-b430-4acc-b26c-f10d05e7782e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:26.998438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d810ee-b430-4acc-b26c-f10d05e7782e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:27.022283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1034/2081] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:26 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:27.023579 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb7e91-387b-49ea-bf56-9599defd2a8d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:27.043343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb7e91-387b-49ea-bf56-9599defd2a8d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:27.048696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cabcf-5c94-44bb-afb5-6b7e233b7739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:27.049915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cabcf-5c94-44bb-afb5-6b7e233b7739 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:27.050549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cabcf-5c94-44bb-afb5-6b7e233b7739 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:27.051721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cabcf-5c94-44bb-afb5-6b7e233b7739 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:27.053039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cabcf-5c94-44bb-afb5-6b7e233b7739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:27.055519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cabcf-5c94-44bb-afb5-6b7e233b7739 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:27.068798 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1048/2082] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:27.072756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d810ee-b430-4acc-b26c-f10d05e7782e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:27.082985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d810ee-b430-4acc-b26c-f10d05e7782e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:27.087504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f214cc-c24a-4fe2-a440-661122d8c6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:27.088174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f214cc-c24a-4fe2-a440-661122d8c6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:27.088457 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f214cc-c24a-4fe2-a440-661122d8c6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:27.088735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f214cc-c24a-4fe2-a440-661122d8c6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:27.089466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f214cc-c24a-4fe2-a440-661122d8c6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:27.091105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f214cc-c24a-4fe2-a440-661122d8c6c5 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:27.101481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1035/2083] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:27.105875 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cabcf-5c94-44bb-afb5-6b7e233b7739 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:27.116179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cabcf-5c94-44bb-afb5-6b7e233b7739 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:27.120754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aa728-113f-4182-9294-420729092430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:27.121641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aa728-113f-4182-9294-420729092430 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:27.121915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aa728-113f-4182-9294-420729092430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:27.122217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aa728-113f-4182-9294-420729092430 admin admin] PATH_INFO: `/v3/projects/73ffb2900fbc4b208cbf76f1b01c78aa/users/09c7e6f3e9a94b9cb146f37f83635e89/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:27.137956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172aa728-113f-4182-9294-420729092430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ffb2900fbc4b208cbf76f1b01c78aa, user_id=09c7e6f3e9a94b9cb146f37f83635e89, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:27.140859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172aa728-113f-4182-9294-420729092430 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:27.154672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1049/2084] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:27 2022] PUT /identity/v3/projects/73ffb2900fbc4b208cbf76f1b01c78aa/users/09c7e6f3e9a94b9cb146f37f83635e89/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:27.166421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5129709-dc52-47f5-9608-7a589135d0e2 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:27.166713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5129709-dc52-47f5-9608-7a589135d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:27.166994 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5129709-dc52-47f5-9608-7a589135d0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:27.198702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-a5129709-dc52-47f5-9608-7a589135d0e2 None None] MFA Rules not processed for user `09c7e6f3e9a94b9cb146f37f83635e89`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:27.200220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a5129709-dc52-47f5-9608-7a589135d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:27.333692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1036/2085] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:27.338808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aa728-113f-4182-9294-420729092430 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:27.403177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5129709-dc52-47f5-9608-7a589135d0e2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:27.405596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a5129709-dc52-47f5-9608-7a589135d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:27.503909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aa728-113f-4182-9294-420729092430 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:27.509447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc96d-afdb-4a05-ad3b-e3e528a5b635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:27.510619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc96d-afdb-4a05-ad3b-e3e528a5b635 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:27.511251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc96d-afdb-4a05-ad3b-e3e528a5b635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:27.511251 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc96d-afdb-4a05-ad3b-e3e528a5b635 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:27.511857 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddc96d-afdb-4a05-ad3b-e3e528a5b635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:27.514508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddc96d-afdb-4a05-ad3b-e3e528a5b635 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:27.533790 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5129709-dc52-47f5-9608-7a589135d0e2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:27.540660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:27.541715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:27.542028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:27.542549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] PATH_INFO: `/v3/users/45f67d5404a54666ac8fb9b03eef0b8a` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:27.543789 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f67d5404a54666ac8fb9b03eef0b8a)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:27.545844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:27.557889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1050/2086] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:27 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:27.559297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc96d-afdb-4a05-ad3b-e3e528a5b635 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:27.647459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f67d5404a54666ac8fb9b03eef0b8a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:27.672385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc96d-afdb-4a05-ad3b-e3e528a5b635 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:27.686406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f67d5404a54666ac8fb9b03eef0b8a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:27.687537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20463c4-1f0e-4978-ad14-5d658c52fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:27.687843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f67d5404a54666ac8fb9b03eef0b8a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:27.688457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20463c4-1f0e-4978-ad14-5d658c52fd43 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:27.688747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20463c4-1f0e-4978-ad14-5d658c52fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:27.689026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20463c4-1f0e-4978-ad14-5d658c52fd43 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:27.689905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20463c4-1f0e-4978-ad14-5d658c52fd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:27.696236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20463c4-1f0e-4978-ad14-5d658c52fd43 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:27.700881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f67d5404a54666ac8fb9b03eef0b8a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:27.702790 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7937cd2-f7a5-448d-9ce5-a787a595e215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f67d5404a54666ac8fb9b03eef0b8a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:27.722127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1037/2087] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:27 2022] DELETE /identity/v3/users/45f67d5404a54666ac8fb9b03eef0b8a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:27.725116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d715-1c80-4c3e-9636-d523252dbe02 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:27.728641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d715-1c80-4c3e-9636-d523252dbe02 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:27.729148 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d715-1c80-4c3e-9636-d523252dbe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:27.730011 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1051/2088] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:27 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:27.733812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20463c4-1f0e-4978-ad14-5d658c52fd43 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:27.747962 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-a20463c4-1f0e-4978-ad14-5d658c52fd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:27.766288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c9a0d715-1c80-4c3e-9636-d523252dbe02 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:27.767133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c9a0d715-1c80-4c3e-9636-d523252dbe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:27.798483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20463c4-1f0e-4978-ad14-5d658c52fd43 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:27.834274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1038/2089] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:27.844226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d715-1c80-4c3e-9636-d523252dbe02 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:27.845806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c9a0d715-1c80-4c3e-9636-d523252dbe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:27.955092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdab6c3-8aa8-449f-a6aa-102c8941f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:27.956106 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab6c3-8aa8-449f-a6aa-102c8941f838 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:27.956993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab6c3-8aa8-449f-a6aa-102c8941f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:27.957326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab6c3-8aa8-449f-a6aa-102c8941f838 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:27.958323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdab6c3-8aa8-449f-a6aa-102c8941f838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:27.960082 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdab6c3-8aa8-449f-a6aa-102c8941f838 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:27.964954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d715-1c80-4c3e-9636-d523252dbe02 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:27.972044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918997a7-724b-4d50-919f-fefa6fadf957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:27.973982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918997a7-724b-4d50-919f-fefa6fadf957 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:27.974279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918997a7-724b-4d50-919f-fefa6fadf957 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:27.974557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918997a7-724b-4d50-919f-fefa6fadf957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:27.987012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1052/2090] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:27.991487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdab6c3-8aa8-449f-a6aa-102c8941f838 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:27.995439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1fdab6c3-8aa8-449f-a6aa-102c8941f838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:27.997316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918997a7-724b-4d50-919f-fefa6fadf957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:28.000722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918997a7-724b-4d50-919f-fefa6fadf957 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:28.024168 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdab6c3-8aa8-449f-a6aa-102c8941f838 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:28.038873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1039/2091] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:28.041539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:28.042428 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918997a7-724b-4d50-919f-fefa6fadf957 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:28.043308 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:28.045018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:28.045455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] PATH_INFO: `/v3/users/f7e341d336174e42babf2a98618dc4fc` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:28.049923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e341d336174e42babf2a98618dc4fc)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:28.056544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:28.077275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918997a7-724b-4d50-919f-fefa6fadf957 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:28.094124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277e299-0ddb-48c0-820f-f0ae252497b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:28.095061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277e299-0ddb-48c0-820f-f0ae252497b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:28.095342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277e299-0ddb-48c0-820f-f0ae252497b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:28.095617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277e299-0ddb-48c0-820f-f0ae252497b0 admin admin] PATH_INFO: `/v3/projects/a2fbe49e2194458e8628304abc916f04/users/c64d6821ce8240f397e7f29a401fcf43/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:28.147055 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277e299-0ddb-48c0-820f-f0ae252497b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fbe49e2194458e8628304abc916f04, user_id=c64d6821ce8240f397e7f29a401fcf43, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:28.153131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277e299-0ddb-48c0-820f-f0ae252497b0 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:28.173745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e341d336174e42babf2a98618dc4fc'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:28.184390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1040/2092] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:28 2022] PUT /identity/v3/projects/a2fbe49e2194458e8628304abc916f04/users/c64d6821ce8240f397e7f29a401fcf43/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:28.188481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277e299-0ddb-48c0-820f-f0ae252497b0 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:28.226872 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e341d336174e42babf2a98618dc4fc'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:28.227646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e341d336174e42babf2a98618dc4fc'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:28.228778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e341d336174e42babf2a98618dc4fc'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:28.247676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-8d722269-7033-4584-8996-857b1915b997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e341d336174e42babf2a98618dc4fc'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:28.280716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1053/2093] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:27 2022] DELETE /identity/v3/users/f7e341d336174e42babf2a98618dc4fc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:28.286567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcf8ae-def8-42cf-bb9d-98d7d3d6d900 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:28.287597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcf8ae-def8-42cf-bb9d-98d7d3d6d900 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:28.290224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcf8ae-def8-42cf-bb9d-98d7d3d6d900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:28.320169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277e299-0ddb-48c0-820f-f0ae252497b0 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:28.331258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-55fcf8ae-def8-42cf-bb9d-98d7d3d6d900 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:28.332664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-55fcf8ae-def8-42cf-bb9d-98d7d3d6d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:28.405570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1054/2094] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:28.416901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bb97d-518f-423f-b3a0-bed43d78615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:28.417600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb97d-518f-423f-b3a0-bed43d78615e admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:28.417913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb97d-518f-423f-b3a0-bed43d78615e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:28.418184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb97d-518f-423f-b3a0-bed43d78615e admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:28.418935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bb97d-518f-423f-b3a0-bed43d78615e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:28.419449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcf8ae-def8-42cf-bb9d-98d7d3d6d900 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:28.421447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-55fcf8ae-def8-42cf-bb9d-98d7d3d6d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:28.424938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bb97d-518f-423f-b3a0-bed43d78615e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:28.446126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1041/2095] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:28.450618 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bb97d-518f-423f-b3a0-bed43d78615e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:28.456917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-852bb97d-518f-423f-b3a0-bed43d78615e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:28.491097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bb97d-518f-423f-b3a0-bed43d78615e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:28.499694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cccf79-45c9-4503-bcb0-1e8f0626f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:28.500765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cccf79-45c9-4503-bcb0-1e8f0626f33d admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:28.501090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cccf79-45c9-4503-bcb0-1e8f0626f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:28.501412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cccf79-45c9-4503-bcb0-1e8f0626f33d admin admin] PATH_INFO: `/v3/projects/a2fbe49e2194458e8628304abc916f04/users/c64d6821ce8240f397e7f29a401fcf43/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:28.504127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cccf79-45c9-4503-bcb0-1e8f0626f33d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fbe49e2194458e8628304abc916f04, user_id=c64d6821ce8240f397e7f29a401fcf43, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:28.507285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cccf79-45c9-4503-bcb0-1e8f0626f33d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:28.516719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcf8ae-def8-42cf-bb9d-98d7d3d6d900 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:28.531084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1042/2096] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:28 2022] PUT /identity/v3/projects/a2fbe49e2194458e8628304abc916f04/users/c64d6821ce8240f397e7f29a401fcf43/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:28.532668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e767e-d2d5-49a6-961f-516d4dd957b6 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:28.533521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e767e-d2d5-49a6-961f-516d4dd957b6 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:28.533722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e767e-d2d5-49a6-961f-516d4dd957b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:28.562658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b45e767e-d2d5-49a6-961f-516d4dd957b6 None None] MFA Rules not processed for user `c64d6821ce8240f397e7f29a401fcf43`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:28.563860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b45e767e-d2d5-49a6-961f-516d4dd957b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:28.593053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6d2e4-d5fc-4ceb-b3d5-6e37b8d35215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:28.593801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6d2e4-d5fc-4ceb-b3d5-6e37b8d35215 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:28.594163 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6d2e4-d5fc-4ceb-b3d5-6e37b8d35215 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:28.594492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6d2e4-d5fc-4ceb-b3d5-6e37b8d35215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:28.682950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1043/2097] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:28.694360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e767e-d2d5-49a6-961f-516d4dd957b6 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:28.696079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b45e767e-d2d5-49a6-961f-516d4dd957b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:28.732834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6d2e4-d5fc-4ceb-b3d5-6e37b8d35215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:28.734790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6d2e4-d5fc-4ceb-b3d5-6e37b8d35215 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:28.749290 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1055/2098] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:28.792269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e767e-d2d5-49a6-961f-516d4dd957b6 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:28.796683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b067ea2-63bc-45c4-b374-21b6e96089df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:28.797326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b067ea2-63bc-45c4-b374-21b6e96089df service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:28.797613 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b067ea2-63bc-45c4-b374-21b6e96089df service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:28.797890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b067ea2-63bc-45c4-b374-21b6e96089df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:28.811212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b067ea2-63bc-45c4-b374-21b6e96089df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:28.813860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b067ea2-63bc-45c4-b374-21b6e96089df service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:28.838188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1044/2099] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:28.847212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6d2e4-d5fc-4ceb-b3d5-6e37b8d35215 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:28.848702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7fb6d2e4-d5fc-4ceb-b3d5-6e37b8d35215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:28.865834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6d2e4-d5fc-4ceb-b3d5-6e37b8d35215 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:28.872613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:28.873578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:28.874039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:28.877335 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] PATH_INFO: `/v3/projects/d1b7751a3baa4380be4667a1996daefe` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:28.882771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b7751a3baa4380be4667a1996daefe)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:28.887788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:29.014598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b7751a3baa4380be4667a1996daefe', 'request_id': 'req-f6471f3a-d3f4-439a-9145-110bb5987b8c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.025902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b7751a3baa4380be4667a1996daefe', 'request_id': 'req-f6471f3a-d3f4-439a-9145-110bb5987b8c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.059906 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b7751a3baa4380be4667a1996daefe', 'request_id': 'req-f6471f3a-d3f4-439a-9145-110bb5987b8c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.084451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] The token cache is being invalidate because project d1b7751a3baa4380be4667a1996daefe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:29.084879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.090394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.092181 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1056/2100] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:28 2022] DELETE /identity/v3/projects/d1b7751a3baa4380be4667a1996daefe => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:29.096893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b067ea2-63bc-45c4-b374-21b6e96089df service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:29.112481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b067ea2-63bc-45c4-b374-21b6e96089df service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:29.244214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:29.245934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:29.251081 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:29.253359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:29.253641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:29.253916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] PATH_INFO: `/v3/users/13989c048f074e7db5561a1ee13f1385` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:29.255365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13989c048f074e7db5561a1ee13f1385)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:29.260738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:29.268343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6471f3a-d3f4-439a-9145-110bb5987b8c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:29.297256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:29.298518 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:29.299025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:29.299443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] PATH_INFO: `/v3/projects/9634552b055e48e2a84ad722a06b5ec4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:29.301981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9634552b055e48e2a84ad722a06b5ec4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:29.304103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:29.368880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13989c048f074e7db5561a1ee13f1385'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.393953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13989c048f074e7db5561a1ee13f1385'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.395620 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13989c048f074e7db5561a1ee13f1385'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.414131 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9634552b055e48e2a84ad722a06b5ec4', 'request_id': 'req-b4ef7ad6-7488-46e7-8dcb-21fea864425a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.416058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13989c048f074e7db5561a1ee13f1385'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.417133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13989c048f074e7db5561a1ee13f1385'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.433725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9634552b055e48e2a84ad722a06b5ec4', 'request_id': 'req-b4ef7ad6-7488-46e7-8dcb-21fea864425a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.441099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1045/2101] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:29 2022] DELETE /identity/v3/users/13989c048f074e7db5561a1ee13f1385 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:29.463964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9634552b055e48e2a84ad722a06b5ec4', 'request_id': 'req-b4ef7ad6-7488-46e7-8dcb-21fea864425a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.494793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] The token cache is being invalidate because project 9634552b055e48e2a84ad722a06b5ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:29.495955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.498311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.507279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:29.508768 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:29.508952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1057/2102] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:29 2022] DELETE /identity/v3/projects/9634552b055e48e2a84ad722a06b5ec4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:29.667530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:29.668787 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2340de2-6dc6-47f3-90f8-f6e8ef0ea51f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:29.669341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:29.681165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:29.682360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:29.682713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:29.683054 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] PATH_INFO: `/v3/users/e113eb4774a14186845834d46b59be5f` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:29.687025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e113eb4774a14186845834d46b59be5f)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:29.689106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:29.781405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e113eb4774a14186845834d46b59be5f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.798963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e113eb4774a14186845834d46b59be5f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.800292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e113eb4774a14186845834d46b59be5f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.815554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e113eb4774a14186845834d46b59be5f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.816356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e113eb4774a14186845834d46b59be5f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:29.846656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1046/2103] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:29 2022] DELETE /identity/v3/users/e113eb4774a14186845834d46b59be5f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:29.892628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef7ad6-7488-46e7-8dcb-21fea864425a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:29.958250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:29.959306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:29.959759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:29.960270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] PATH_INFO: `/v3/users/09c7e6f3e9a94b9cb146f37f83635e89` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:29.961798 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c7e6f3e9a94b9cb146f37f83635e89)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:29.964132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:29.969081 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:29.971102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:30.003127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998d5b0-85c3-4d5f-beed-3f8b3f37b411 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.013466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.017995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.019041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.019478 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] PATH_INFO: `/v3/projects/badfea041d254c7690597e09abaa6e4c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.021263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=badfea041d254c7690597e09abaa6e4c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.023543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.059883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c7e6f3e9a94b9cb146f37f83635e89'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.090744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c7e6f3e9a94b9cb146f37f83635e89'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.092419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c7e6f3e9a94b9cb146f37f83635e89'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.099736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c7e6f3e9a94b9cb146f37f83635e89'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.114880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-42bded90-e6cb-4bbf-968d-51df151d40c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c7e6f3e9a94b9cb146f37f83635e89'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.135318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1058/2104] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:29 2022] DELETE /identity/v3/users/09c7e6f3e9a94b9cb146f37f83635e89 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:30.140448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa9e8-1ca0-4d54-92c5-4a6a13da9ce8 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.141103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa9e8-1ca0-4d54-92c5-4a6a13da9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.141560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa9e8-1ca0-4d54-92c5-4a6a13da9ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.160391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badfea041d254c7690597e09abaa6e4c', 'request_id': 'req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.170407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d38aa9e8-1ca0-4d54-92c5-4a6a13da9ce8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:30.170407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d38aa9e8-1ca0-4d54-92c5-4a6a13da9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:30.207813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badfea041d254c7690597e09abaa6e4c', 'request_id': 'req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.224067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badfea041d254c7690597e09abaa6e4c', 'request_id': 'req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.245340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] The token cache is being invalidate because project badfea041d254c7690597e09abaa6e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:30.245780 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.246649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fd246c77-ec3a-4e70-bb23-f2c2aadfbc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.250817 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1047/2105] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:29 2022] DELETE /identity/v3/projects/badfea041d254c7690597e09abaa6e4c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:30.255711 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a089a-31f5-465c-be81-335db65ae473 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.256072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a089a-31f5-465c-be81-335db65ae473 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.258022 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a089a-31f5-465c-be81-335db65ae473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.264763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1059/2106] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:30.281038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38aa9e8-1ca0-4d54-92c5-4a6a13da9ce8 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.282980 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d38aa9e8-1ca0-4d54-92c5-4a6a13da9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:30.290697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-887a089a-31f5-465c-be81-335db65ae473 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:30.292205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-887a089a-31f5-465c-be81-335db65ae473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:30.315314 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1048/2107] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:30.323118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b0e60-8e33-47db-a8df-63cbf5928500 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.323692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b0e60-8e33-47db-a8df-63cbf5928500 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.324377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b0e60-8e33-47db-a8df-63cbf5928500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.361343 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-3b9b0e60-8e33-47db-a8df-63cbf5928500 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:30.362571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3b9b0e60-8e33-47db-a8df-63cbf5928500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:30.364288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38aa9e8-1ca0-4d54-92c5-4a6a13da9ce8 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.368966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809e8b7-46d9-4035-8323-3548b2110279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.369745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809e8b7-46d9-4035-8323-3548b2110279 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.370175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809e8b7-46d9-4035-8323-3548b2110279 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.370994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809e8b7-46d9-4035-8323-3548b2110279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.385650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1049/2108] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:30.392273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b0e60-8e33-47db-a8df-63cbf5928500 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.405572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b0e60-8e33-47db-a8df-63cbf5928500 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.413119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809e8b7-46d9-4035-8323-3548b2110279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.414886 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809e8b7-46d9-4035-8323-3548b2110279 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.419835 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b928aa-b2b5-42d1-b808-8bdd0d5e83ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.420646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b928aa-b2b5-42d1-b808-8bdd0d5e83ea admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.420996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b928aa-b2b5-42d1-b808-8bdd0d5e83ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.421986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b928aa-b2b5-42d1-b808-8bdd0d5e83ea admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.423091 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b928aa-b2b5-42d1-b808-8bdd0d5e83ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:30.423400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b928aa-b2b5-42d1-b808-8bdd0d5e83ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.425517 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b928aa-b2b5-42d1-b808-8bdd0d5e83ea admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.426580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1060/2109] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:30.427492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809e8b7-46d9-4035-8323-3548b2110279 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.428782 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6809e8b7-46d9-4035-8323-3548b2110279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:30.442548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809e8b7-46d9-4035-8323-3548b2110279 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.447129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1050/2110] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:30.451464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b928aa-b2b5-42d1-b808-8bdd0d5e83ea admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.462934 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.463985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.464274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.464402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b928aa-b2b5-42d1-b808-8bdd0d5e83ea admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.464568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] PATH_INFO: `/v3/projects/0f0e776a99c3451eb56bbf6542dd8acd` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.466744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0e776a99c3451eb56bbf6542dd8acd)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.469443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.469759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fb9e4-26c5-4f34-a0c8-fb09e184cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.470471 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb9e4-26c5-4f34-a0c8-fb09e184cf23 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.470806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb9e4-26c5-4f34-a0c8-fb09e184cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.471817 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb9e4-26c5-4f34-a0c8-fb09e184cf23 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.472877 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fb9e4-26c5-4f34-a0c8-fb09e184cf23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.474956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fb9e4-26c5-4f34-a0c8-fb09e184cf23 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.512053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1051/2111] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:30 2022] POST /identity/v3/projects => generated 359 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:30.516504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fb9e4-26c5-4f34-a0c8-fb09e184cf23 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.542855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0e776a99c3451eb56bbf6542dd8acd', 'request_id': 'req-08e1b587-9e6c-4950-8a81-96768510660e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.552570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0e776a99c3451eb56bbf6542dd8acd', 'request_id': 'req-08e1b587-9e6c-4950-8a81-96768510660e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.562655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0e776a99c3451eb56bbf6542dd8acd', 'request_id': 'req-08e1b587-9e6c-4950-8a81-96768510660e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.580952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] The token cache is being invalidate because project 0f0e776a99c3451eb56bbf6542dd8acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:30.581305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.582007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08e1b587-9e6c-4950-8a81-96768510660e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.586113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1061/2112] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:30 2022] DELETE /identity/v3/projects/0f0e776a99c3451eb56bbf6542dd8acd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:30.592143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e195-3b99-427d-ac4a-a5b17722a689 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.593347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e195-3b99-427d-ac4a-a5b17722a689 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.593880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e195-3b99-427d-ac4a-a5b17722a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.600021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fb9e4-26c5-4f34-a0c8-fb09e184cf23 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.624312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ef17e195-3b99-427d-ac4a-a5b17722a689 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:30.624312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ef17e195-3b99-427d-ac4a-a5b17722a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:30.684469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc534cf-a76b-42ac-b75d-9287770d9e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.685828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc534cf-a76b-42ac-b75d-9287770d9e27 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.686330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc534cf-a76b-42ac-b75d-9287770d9e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.686851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc534cf-a76b-42ac-b75d-9287770d9e27 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.687836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc534cf-a76b-42ac-b75d-9287770d9e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.690216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc534cf-a76b-42ac-b75d-9287770d9e27 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.700014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1062/2113] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:30.702528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d223-b5d5-4e6f-9d0c-b797fc1b80e5 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.702528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d223-b5d5-4e6f-9d0c-b797fc1b80e5 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.702753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d223-b5d5-4e6f-9d0c-b797fc1b80e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.720089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1052/2114] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:30 2022] POST /identity/v3/users => generated 280 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:30.724321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc534cf-a76b-42ac-b75d-9287770d9e27 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.726024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5bc534cf-a76b-42ac-b75d-9287770d9e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:30.731837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-1e54d223-b5d5-4e6f-9d0c-b797fc1b80e5 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:30.733331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1e54d223-b5d5-4e6f-9d0c-b797fc1b80e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:30.745974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1063/2115] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:30.749419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54d223-b5d5-4e6f-9d0c-b797fc1b80e5 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.752349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc534cf-a76b-42ac-b75d-9287770d9e27 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.759310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2ab81-6884-4058-aa61-0ebd1b4bb732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.760298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2ab81-6884-4058-aa61-0ebd1b4bb732 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.760670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2ab81-6884-4058-aa61-0ebd1b4bb732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.761034 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2ab81-6884-4058-aa61-0ebd1b4bb732 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.761979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2ab81-6884-4058-aa61-0ebd1b4bb732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.763821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2ab81-6884-4058-aa61-0ebd1b4bb732 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.764368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54d223-b5d5-4e6f-9d0c-b797fc1b80e5 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.770111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29341a-1b36-4714-b47d-c9abea5fa732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.770975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29341a-1b36-4714-b47d-c9abea5fa732 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.771422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29341a-1b36-4714-b47d-c9abea5fa732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.771857 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29341a-1b36-4714-b47d-c9abea5fa732 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.773263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29341a-1b36-4714-b47d-c9abea5fa732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:30.774005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29341a-1b36-4714-b47d-c9abea5fa732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.776729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29341a-1b36-4714-b47d-c9abea5fa732 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.788060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1053/2116] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:30.789348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2ab81-6884-4058-aa61-0ebd1b4bb732 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.792230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1064/2117] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:53:30.796964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29341a-1b36-4714-b47d-c9abea5fa732 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.802514 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2ab81-6884-4058-aa61-0ebd1b4bb732 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.807374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29341a-1b36-4714-b47d-c9abea5fa732 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.808818 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f0a17-c6bc-4a41-a618-4bd4b3845ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.809633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f0a17-c6bc-4a41-a618-4bd4b3845ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.809972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f0a17-c6bc-4a41-a618-4bd4b3845ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.810721 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f0a17-c6bc-4a41-a618-4bd4b3845ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.811470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f0a17-c6bc-4a41-a618-4bd4b3845ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.812805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dca71-b413-4704-8021-494ee08d2a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.813228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f0a17-c6bc-4a41-a618-4bd4b3845ab0 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.813565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dca71-b413-4704-8021-494ee08d2a1d admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.813941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dca71-b413-4704-8021-494ee08d2a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.814305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dca71-b413-4704-8021-494ee08d2a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.815356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dca71-b413-4704-8021-494ee08d2a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.817580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dca71-b413-4704-8021-494ee08d2a1d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.827071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1054/2118] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:30.828026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f0a17-c6bc-4a41-a618-4bd4b3845ab0 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.831008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-de3f0a17-c6bc-4a41-a618-4bd4b3845ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:30.848031 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f0a17-c6bc-4a41-a618-4bd4b3845ab0 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.849321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1065/2119] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:30 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:30.853180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dca71-b413-4704-8021-494ee08d2a1d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.902507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.903356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.903639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.903939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] PATH_INFO: `/v3/projects/73ffb2900fbc4b208cbf76f1b01c78aa` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.905127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ffb2900fbc4b208cbf76f1b01c78aa)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.907160 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.910574 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dca71-b413-4704-8021-494ee08d2a1d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:30.915682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21756f-f727-4a7c-8501-1791d7a31515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:30.916578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21756f-f727-4a7c-8501-1791d7a31515 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.916858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21756f-f727-4a7c-8501-1791d7a31515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.917130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21756f-f727-4a7c-8501-1791d7a31515 admin admin] PATH_INFO: `/v3/projects/7e8612ae3e114697b1e93c15014a0e45/users/25f33d54b6b341788ece5dfe3a4fabed/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:30.931553 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21756f-f727-4a7c-8501-1791d7a31515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8612ae3e114697b1e93c15014a0e45, user_id=25f33d54b6b341788ece5dfe3a4fabed, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:30.934719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21756f-f727-4a7c-8501-1791d7a31515 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:30.948271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1066/2120] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:30 2022] PUT /identity/v3/projects/7e8612ae3e114697b1e93c15014a0e45/users/25f33d54b6b341788ece5dfe3a4fabed/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:30.949034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21756f-f727-4a7c-8501-1791d7a31515 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:30.956494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ffb2900fbc4b208cbf76f1b01c78aa', 'request_id': 'req-266d0918-b041-4250-a2da-40484217ce17'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.962754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ffb2900fbc4b208cbf76f1b01c78aa', 'request_id': 'req-266d0918-b041-4250-a2da-40484217ce17'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.971727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ffb2900fbc4b208cbf76f1b01c78aa', 'request_id': 'req-266d0918-b041-4250-a2da-40484217ce17'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.981902 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] The token cache is being invalidate because project 73ffb2900fbc4b208cbf76f1b01c78aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:30.982226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.982862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-266d0918-b041-4250-a2da-40484217ce17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:30.984473 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1055/2121] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:30 2022] DELETE /identity/v3/projects/73ffb2900fbc4b208cbf76f1b01c78aa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:30.985775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410d25-2103-4937-a307-5049086a7834 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:30.986062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410d25-2103-4937-a307-5049086a7834 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:30.986369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410d25-2103-4937-a307-5049086a7834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.011932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-03410d25-2103-4937-a307-5049086a7834 None None] MFA Rules not processed for user `25f33d54b6b341788ece5dfe3a4fabed`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:31.013139 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-03410d25-2103-4937-a307-5049086a7834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.016151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21756f-f727-4a7c-8501-1791d7a31515 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.069850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6258f-bfa8-4892-af21-605a4719d088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.070675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6258f-bfa8-4892-af21-605a4719d088 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.070961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6258f-bfa8-4892-af21-605a4719d088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.071231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6258f-bfa8-4892-af21-605a4719d088 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.071922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6258f-bfa8-4892-af21-605a4719d088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.074102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6258f-bfa8-4892-af21-605a4719d088 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.075409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1056/2122] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:31.076247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03410d25-2103-4937-a307-5049086a7834 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.077544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-03410d25-2103-4937-a307-5049086a7834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.092086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03410d25-2103-4937-a307-5049086a7834 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.098763 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.099809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.100088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.100409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] PATH_INFO: `/v3/users/c64d6821ce8240f397e7f29a401fcf43` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.101666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64d6821ce8240f397e7f29a401fcf43)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.103709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.104971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1067/2123] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:30 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:31.109016 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6258f-bfa8-4892-af21-605a4719d088 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.110761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5db6258f-bfa8-4892-af21-605a4719d088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.122624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6258f-bfa8-4892-af21-605a4719d088 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.127648 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a76369-24c2-4723-be67-2105d1c1a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.128340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a76369-24c2-4723-be67-2105d1c1a121 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.128618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a76369-24c2-4723-be67-2105d1c1a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.128889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a76369-24c2-4723-be67-2105d1c1a121 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.129643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a76369-24c2-4723-be67-2105d1c1a121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.131346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a76369-24c2-4723-be67-2105d1c1a121 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.142257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1068/2124] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:31.142257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a76369-24c2-4723-be67-2105d1c1a121 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.142257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-74a76369-24c2-4723-be67-2105d1c1a121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.154306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64d6821ce8240f397e7f29a401fcf43'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.169599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64d6821ce8240f397e7f29a401fcf43'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.170398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64d6821ce8240f397e7f29a401fcf43'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.178525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64d6821ce8240f397e7f29a401fcf43'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.179128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64d6821ce8240f397e7f29a401fcf43'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.194808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1057/2125] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:31 2022] DELETE /identity/v3/users/c64d6821ce8240f397e7f29a401fcf43 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:31.194808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.194808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.212809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a76369-24c2-4723-be67-2105d1c1a121 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.260315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc025a-30db-4f67-b714-a3f405e9ab1c admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.266691 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d1368-9ff2-46d9-8cdd-a4d72bb2b1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.267840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d1368-9ff2-46d9-8cdd-a4d72bb2b1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.268441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d1368-9ff2-46d9-8cdd-a4d72bb2b1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.268944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d1368-9ff2-46d9-8cdd-a4d72bb2b1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.269421 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b982c-356e-480b-bdf4-830fadbcaa45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.270157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b982c-356e-480b-bdf4-830fadbcaa45 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.270436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b982c-356e-480b-bdf4-830fadbcaa45 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.270685 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d1368-9ff2-46d9-8cdd-a4d72bb2b1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.270786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b982c-356e-480b-bdf4-830fadbcaa45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.272736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d1368-9ff2-46d9-8cdd-a4d72bb2b1a6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.274045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-248b982c-356e-480b-bdf4-830fadbcaa45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.286405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1058/2126] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:31.288444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d1368-9ff2-46d9-8cdd-a4d72bb2b1a6 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.300075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d1368-9ff2-46d9-8cdd-a4d72bb2b1a6 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.304724 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b9961-9a87-4b85-94e2-277ea9432e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.305616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b9961-9a87-4b85-94e2-277ea9432e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.305892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b9961-9a87-4b85-94e2-277ea9432e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.306199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b9961-9a87-4b85-94e2-277ea9432e4f admin admin] PATH_INFO: `/v3/projects/0ea9d3b0a3cc4e8e8769904e5fb31ac2/users/7cec4bd7337b4cf19a8a2794f5cea78e/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.322843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b9961-9a87-4b85-94e2-277ea9432e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea9d3b0a3cc4e8e8769904e5fb31ac2, user_id=7cec4bd7337b4cf19a8a2794f5cea78e, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.325876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b9961-9a87-4b85-94e2-277ea9432e4f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.340876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1059/2127] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:31 2022] PUT /identity/v3/projects/0ea9d3b0a3cc4e8e8769904e5fb31ac2/users/7cec4bd7337b4cf19a8a2794f5cea78e/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:31.351087 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b982c-356e-480b-bdf4-830fadbcaa45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.351414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb501a2-ff0d-47ce-90d8-d8101dc1ed47 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.351695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb501a2-ff0d-47ce-90d8-d8101dc1ed47 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.352133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb501a2-ff0d-47ce-90d8-d8101dc1ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.354074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b982c-356e-480b-bdf4-830fadbcaa45 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.365006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1069/2128] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:31 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:31.380735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b982c-356e-480b-bdf4-830fadbcaa45 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.382140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-248b982c-356e-480b-bdf4-830fadbcaa45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.385358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0bb501a2-ff0d-47ce-90d8-d8101dc1ed47 None None] MFA Rules not processed for user `7cec4bd7337b4cf19a8a2794f5cea78e`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:31.386573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0bb501a2-ff0d-47ce-90d8-d8101dc1ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.397658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b982c-356e-480b-bdf4-830fadbcaa45 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.464291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1060/2129] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:31.483083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb501a2-ff0d-47ce-90d8-d8101dc1ed47 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.509866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.514883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.515168 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.515440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] PATH_INFO: `/v3/users/25f33d54b6b341788ece5dfe3a4fabed` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.517594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f33d54b6b341788ece5dfe3a4fabed)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.521037 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.588167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb501a2-ff0d-47ce-90d8-d8101dc1ed47 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.593073 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceca74-b265-4d64-bc8f-ec58ea997e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.593923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceca74-b265-4d64-bc8f-ec58ea997e47 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.594349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceca74-b265-4d64-bc8f-ec58ea997e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.594634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceca74-b265-4d64-bc8f-ec58ea997e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.595398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ceca74-b265-4d64-bc8f-ec58ea997e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.597315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ceca74-b265-4d64-bc8f-ec58ea997e47 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.602626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f33d54b6b341788ece5dfe3a4fabed'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.614507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f33d54b6b341788ece5dfe3a4fabed'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.615389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f33d54b6b341788ece5dfe3a4fabed'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.616048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f33d54b6b341788ece5dfe3a4fabed'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.624058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f33d54b6b341788ece5dfe3a4fabed'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.626715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1061/2130] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:31 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:31.626715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceca74-b265-4d64-bc8f-ec58ea997e47 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.626715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a9ceca74-b265-4d64-bc8f-ec58ea997e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.636676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1070/2131] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:31 2022] DELETE /identity/v3/users/25f33d54b6b341788ece5dfe3a4fabed => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:31.637567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.640886 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.696300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceca74-b265-4d64-bc8f-ec58ea997e47 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.706845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf4ce9-2ee0-4900-a97a-64012e8bb5bb admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.711301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bcb4c-868f-4107-8260-003c3c40f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.711971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bcb4c-868f-4107-8260-003c3c40f2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.712256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bcb4c-868f-4107-8260-003c3c40f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.712566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bcb4c-868f-4107-8260-003c3c40f2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.713366 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bcb4c-868f-4107-8260-003c3c40f2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.715329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bcb4c-868f-4107-8260-003c3c40f2b6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.736003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1071/2132] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:31 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:31.737263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c187-0af3-462c-8d14-297ce402fd1d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.737547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c187-0af3-462c-8d14-297ce402fd1d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.737819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c187-0af3-462c-8d14-297ce402fd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.754106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.754931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-c232c187-0af3-462c-8d14-297ce402fd1d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:31.755071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.755271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.755709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] PATH_INFO: `/v3/projects/a2fbe49e2194458e8628304abc916f04` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.756123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c232c187-0af3-462c-8d14-297ce402fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.756953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fbe49e2194458e8628304abc916f04)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.758855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.764062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1072/2133] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:31.764632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232c187-0af3-462c-8d14-297ce402fd1d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.780551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232c187-0af3-462c-8d14-297ce402fd1d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.787784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743118-6e27-4468-9e5d-b93ae33c8090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.788456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743118-6e27-4468-9e5d-b93ae33c8090 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.788737 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743118-6e27-4468-9e5d-b93ae33c8090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.789668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743118-6e27-4468-9e5d-b93ae33c8090 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.790446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1743118-6e27-4468-9e5d-b93ae33c8090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.792097 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1743118-6e27-4468-9e5d-b93ae33c8090 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.802461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1073/2134] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:31.803614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743118-6e27-4468-9e5d-b93ae33c8090 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.805439 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f1743118-6e27-4468-9e5d-b93ae33c8090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.808462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fbe49e2194458e8628304abc916f04', 'request_id': 'req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.815237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fbe49e2194458e8628304abc916f04', 'request_id': 'req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.823503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fbe49e2194458e8628304abc916f04', 'request_id': 'req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.834004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] The token cache is being invalidate because project a2fbe49e2194458e8628304abc916f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:31.834319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.834980 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:31.836653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1062/2135] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:31 2022] DELETE /identity/v3/projects/a2fbe49e2194458e8628304abc916f04 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:31.837439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.839135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.863312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743118-6e27-4468-9e5d-b93ae33c8090 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.899099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb803c0-171f-4c8c-8213-e61eb8c8d4f8 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.903916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f050e-7038-431b-806f-403067311059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.904851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f050e-7038-431b-806f-403067311059 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.905129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f050e-7038-431b-806f-403067311059 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.905425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f050e-7038-431b-806f-403067311059 admin admin] PATH_INFO: `/v3/projects/b3f31c1122e5421d9e77c1598e2ea6b4/users/924a836e6464430890090993702a9a3c/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.910220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76f7d-88d9-4707-816f-8729028056d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:31.911257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76f7d-88d9-4707-816f-8729028056d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.911535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76f7d-88d9-4707-816f-8729028056d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.911804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76f7d-88d9-4707-816f-8729028056d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.913592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-30c76f7d-88d9-4707-816f-8729028056d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:31.919949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f050e-7038-431b-806f-403067311059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f31c1122e5421d9e77c1598e2ea6b4, user_id=924a836e6464430890090993702a9a3c, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.922756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f050e-7038-431b-806f-403067311059 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.925447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76f7d-88d9-4707-816f-8729028056d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:31.927070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76f7d-88d9-4707-816f-8729028056d6 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:31.935874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1063/2136] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:31 2022] PUT /identity/v3/projects/b3f31c1122e5421d9e77c1598e2ea6b4/users/924a836e6464430890090993702a9a3c/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:31.936777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1074/2137] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:31.937254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ae7f1-f509-49dd-aeaa-6a099bf5e4ef None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:31.937535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ae7f1-f509-49dd-aeaa-6a099bf5e4ef None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:31.937809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ae7f1-f509-49dd-aeaa-6a099bf5e4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:31.939935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76f7d-88d9-4707-816f-8729028056d6 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:31.949611 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76f7d-88d9-4707-816f-8729028056d6 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:31.956561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ed0ae7f1-f509-49dd-aeaa-6a099bf5e4ef None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:31.957838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ed0ae7f1-f509-49dd-aeaa-6a099bf5e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.008536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4ded9-ba6a-45d8-840f-0e1b37b0df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.009598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ded9-ba6a-45d8-840f-0e1b37b0df3a admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.009598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ded9-ba6a-45d8-840f-0e1b37b0df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.009791 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ded9-ba6a-45d8-840f-0e1b37b0df3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.010607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4ded9-ba6a-45d8-840f-0e1b37b0df3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.012765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4ded9-ba6a-45d8-840f-0e1b37b0df3a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.028374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1064/2138] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:32.028592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1075/2139] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:32.028673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ae7f1-f509-49dd-aeaa-6a099bf5e4ef None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.030022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1bb82-f764-470e-a6c7-459d9e8a09bc None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.030336 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1bb82-f764-470e-a6c7-459d9e8a09bc None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.030669 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1bb82-f764-470e-a6c7-459d9e8a09bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.040768 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ae7f1-f509-49dd-aeaa-6a099bf5e4ef None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.046190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9ef39-93a6-4fd9-aaca-f0a11cb54eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.047234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9ef39-93a6-4fd9-aaca-f0a11cb54eff admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.047519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9ef39-93a6-4fd9-aaca-f0a11cb54eff admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.047808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9ef39-93a6-4fd9-aaca-f0a11cb54eff admin admin] PATH_INFO: `/v3/projects/b3f31c1122e5421d9e77c1598e2ea6b4/users/924a836e6464430890090993702a9a3c/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.049476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0bf1bb82-f764-470e-a6c7-459d9e8a09bc None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:32.049759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9ef39-93a6-4fd9-aaca-f0a11cb54eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f31c1122e5421d9e77c1598e2ea6b4, user_id=924a836e6464430890090993702a9a3c, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.050701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0bf1bb82-f764-470e-a6c7-459d9e8a09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.052650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9ef39-93a6-4fd9-aaca-f0a11cb54eff admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.062459 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1076/2140] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:32.063539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1bb82-f764-470e-a6c7-459d9e8a09bc None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.064419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1065/2141] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:32 2022] PUT /identity/v3/projects/b3f31c1122e5421d9e77c1598e2ea6b4/users/924a836e6464430890090993702a9a3c/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:32.073676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1bb82-f764-470e-a6c7-459d9e8a09bc None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.075692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46b9a-8801-429f-ae1d-e2dd4ad25bf5 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.075980 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46b9a-8801-429f-ae1d-e2dd4ad25bf5 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.076261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46b9a-8801-429f-ae1d-e2dd4ad25bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.112855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-63e46b9a-8801-429f-ae1d-e2dd4ad25bf5 None None] MFA Rules not processed for user `924a836e6464430890090993702a9a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:32.114070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-63e46b9a-8801-429f-ae1d-e2dd4ad25bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.139683 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f681337-552e-490e-a4dd-bd51bed0c756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.140570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f681337-552e-490e-a4dd-bd51bed0c756 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.140851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f681337-552e-490e-a4dd-bd51bed0c756 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.141120 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f681337-552e-490e-a4dd-bd51bed0c756 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.141905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f681337-552e-490e-a4dd-bd51bed0c756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:32.142249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f681337-552e-490e-a4dd-bd51bed0c756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.143894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f681337-552e-490e-a4dd-bd51bed0c756 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.156628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1077/2142] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:53:32.161105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f681337-552e-490e-a4dd-bd51bed0c756 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.170809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f681337-552e-490e-a4dd-bd51bed0c756 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.175525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8c5c7-9c5a-47b5-93f8-3ca81e6e715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.176187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c5c7-9c5a-47b5-93f8-3ca81e6e715d admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.176471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c5c7-9c5a-47b5-93f8-3ca81e6e715d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.176746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c5c7-9c5a-47b5-93f8-3ca81e6e715d admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.177558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8c5c7-9c5a-47b5-93f8-3ca81e6e715d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.179545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8c5c7-9c5a-47b5-93f8-3ca81e6e715d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.190336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1066/2143] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:32.201483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e46b9a-8801-429f-ae1d-e2dd4ad25bf5 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.203747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-63e46b9a-8801-429f-ae1d-e2dd4ad25bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.213163 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1078/2144] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:32 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:32.214375 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8c5c7-9c5a-47b5-93f8-3ca81e6e715d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.284018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8c5c7-9c5a-47b5-93f8-3ca81e6e715d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.285307 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e46b9a-8801-429f-ae1d-e2dd4ad25bf5 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.289317 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6250ec4-0a6a-43ab-a0ec-b56f52d9b98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.289992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6250ec4-0a6a-43ab-a0ec-b56f52d9b98b admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.290306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6250ec4-0a6a-43ab-a0ec-b56f52d9b98b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.290580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6250ec4-0a6a-43ab-a0ec-b56f52d9b98b admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.291277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6250ec4-0a6a-43ab-a0ec-b56f52d9b98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.293250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6250ec4-0a6a-43ab-a0ec-b56f52d9b98b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.318727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1079/2145] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:32 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:32.318727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6250ec4-0a6a-43ab-a0ec-b56f52d9b98b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.318727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f6250ec4-0a6a-43ab-a0ec-b56f52d9b98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.330557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6250ec4-0a6a-43ab-a0ec-b56f52d9b98b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.335278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.336128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.336420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.336677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] PATH_INFO: `/v3/projects/7e8612ae3e114697b1e93c15014a0e45` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.337859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8612ae3e114697b1e93c15014a0e45)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.339799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.342315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18eb6-e868-401d-b7d0-13ba039341f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.343003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18eb6-e868-401d-b7d0-13ba039341f6 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.343282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18eb6-e868-401d-b7d0-13ba039341f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.343554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18eb6-e868-401d-b7d0-13ba039341f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.345388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8cd18eb6-e868-401d-b7d0-13ba039341f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.384600 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8612ae3e114697b1e93c15014a0e45', 'request_id': 'req-41266f91-429b-47ca-99d5-3160ef1c9e07'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:32.390885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8612ae3e114697b1e93c15014a0e45', 'request_id': 'req-41266f91-429b-47ca-99d5-3160ef1c9e07'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:32.399607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8612ae3e114697b1e93c15014a0e45', 'request_id': 'req-41266f91-429b-47ca-99d5-3160ef1c9e07'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:32.401872 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18eb6-e868-401d-b7d0-13ba039341f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.403444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18eb6-e868-401d-b7d0-13ba039341f6 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.409885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] The token cache is being invalidate because project 7e8612ae3e114697b1e93c15014a0e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:32.410208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:32.411210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-41266f91-429b-47ca-99d5-3160ef1c9e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:32.412503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1067/2146] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:32.412988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1080/2147] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:32 2022] DELETE /identity/v3/projects/7e8612ae3e114697b1e93c15014a0e45 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:32.413302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18eb6-e868-401d-b7d0-13ba039341f6 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.417707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d663f0-7fdd-4eb1-a6e4-f8202ce45253 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.418010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d663f0-7fdd-4eb1-a6e4-f8202ce45253 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.418401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d663f0-7fdd-4eb1-a6e4-f8202ce45253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.424027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18eb6-e868-401d-b7d0-13ba039341f6 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.436252 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-31d663f0-7fdd-4eb1-a6e4-f8202ce45253 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:32.437479 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-31d663f0-7fdd-4eb1-a6e4-f8202ce45253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.495954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cd58a-9db3-4dc1-b6ac-484edfec885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.497368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cd58a-9db3-4dc1-b6ac-484edfec885f admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.497646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cd58a-9db3-4dc1-b6ac-484edfec885f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.497917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cd58a-9db3-4dc1-b6ac-484edfec885f admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.499009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cd58a-9db3-4dc1-b6ac-484edfec885f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.500501 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1081/2148] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:32.501126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cd58a-9db3-4dc1-b6ac-484edfec885f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.509441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb11bc-90a9-4d68-a095-d993eaa98b27 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.509728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb11bc-90a9-4d68-a095-d993eaa98b27 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.510272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb11bc-90a9-4d68-a095-d993eaa98b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.524656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1068/2149] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:32.528397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cd58a-9db3-4dc1-b6ac-484edfec885f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.530341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5c6cd58a-9db3-4dc1-b6ac-484edfec885f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.532896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-c1bb11bc-90a9-4d68-a095-d993eaa98b27 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:32.534128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c1bb11bc-90a9-4d68-a095-d993eaa98b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.542457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1082/2150] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:32.545758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cd58a-9db3-4dc1-b6ac-484edfec885f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.546521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb11bc-90a9-4d68-a095-d993eaa98b27 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.550515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e15ab-61bf-4c00-85bb-9ab90e9514f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.551214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e15ab-61bf-4c00-85bb-9ab90e9514f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.551999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e15ab-61bf-4c00-85bb-9ab90e9514f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.551999 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e15ab-61bf-4c00-85bb-9ab90e9514f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.552468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e15ab-61bf-4c00-85bb-9ab90e9514f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.554162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e15ab-61bf-4c00-85bb-9ab90e9514f1 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.555285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb11bc-90a9-4d68-a095-d993eaa98b27 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.559852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8b3f9-b37e-4489-99a6-6d5f0de1d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.560508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8b3f9-b37e-4489-99a6-6d5f0de1d966 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.560783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8b3f9-b37e-4489-99a6-6d5f0de1d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.561058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8b3f9-b37e-4489-99a6-6d5f0de1d966 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.561837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8b3f9-b37e-4489-99a6-6d5f0de1d966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:32.562200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8b3f9-b37e-4489-99a6-6d5f0de1d966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.563893 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8b3f9-b37e-4489-99a6-6d5f0de1d966 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.566876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1069/2151] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:32.570838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e15ab-61bf-4c00-85bb-9ab90e9514f1 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.579712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1083/2152] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:53:32.580712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8b3f9-b37e-4489-99a6-6d5f0de1d966 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.580846 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e15ab-61bf-4c00-85bb-9ab90e9514f1 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.586537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f909b-00cb-444f-9546-088f3615f96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.587620 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f909b-00cb-444f-9546-088f3615f96b admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.587923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f909b-00cb-444f-9546-088f3615f96b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.588185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f909b-00cb-444f-9546-088f3615f96b admin admin] PATH_INFO: `/v3/projects/4595909c2afd467c8bb87711e754fefc/users/fbb0bff436264967ad1407ef90f9cde6/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.591287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8b3f9-b37e-4489-99a6-6d5f0de1d966 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.595865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26279c4c-aa4b-4d4e-b68b-7f6d3fd6e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.596600 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26279c4c-aa4b-4d4e-b68b-7f6d3fd6e7cd admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.597034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26279c4c-aa4b-4d4e-b68b-7f6d3fd6e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.597213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26279c4c-aa4b-4d4e-b68b-7f6d3fd6e7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.597894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26279c4c-aa4b-4d4e-b68b-7f6d3fd6e7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.599944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26279c4c-aa4b-4d4e-b68b-7f6d3fd6e7cd admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.611029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f909b-00cb-444f-9546-088f3615f96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4595909c2afd467c8bb87711e754fefc, user_id=fbb0bff436264967ad1407ef90f9cde6, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.614839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f909b-00cb-444f-9546-088f3615f96b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.633236 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1070/2153] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:32 2022] PUT /identity/v3/projects/4595909c2afd467c8bb87711e754fefc/users/fbb0bff436264967ad1407ef90f9cde6/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:32.646186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea6801-1469-41f6-b3df-8961cf0e9c1d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.649953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1084/2154] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:32 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:32.650624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26279c4c-aa4b-4d4e-b68b-7f6d3fd6e7cd admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.652917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea6801-1469-41f6-b3df-8961cf0e9c1d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.653404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea6801-1469-41f6-b3df-8961cf0e9c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.714188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b4ea6801-1469-41f6-b3df-8961cf0e9c1d None None] MFA Rules not processed for user `fbb0bff436264967ad1407ef90f9cde6`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:32.715406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b4ea6801-1469-41f6-b3df-8961cf0e9c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.750681 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26279c4c-aa4b-4d4e-b68b-7f6d3fd6e7cd admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.760478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a29d8-6c9d-4f00-89a9-f84316e3fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.761179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a29d8-6c9d-4f00-89a9-f84316e3fbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.761447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a29d8-6c9d-4f00-89a9-f84316e3fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.761816 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a29d8-6c9d-4f00-89a9-f84316e3fbd9 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.762487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a29d8-6c9d-4f00-89a9-f84316e3fbd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.764940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a29d8-6c9d-4f00-89a9-f84316e3fbd9 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.791882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1085/2155] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:32 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:32.793089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a29d8-6c9d-4f00-89a9-f84316e3fbd9 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.802640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1071/2156] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:32.808603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a29d8-6c9d-4f00-89a9-f84316e3fbd9 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.820530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0036fc-83ed-42eb-9313-1e246927e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.822793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0036fc-83ed-42eb-9313-1e246927e4df admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.823091 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0036fc-83ed-42eb-9313-1e246927e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.823554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0036fc-83ed-42eb-9313-1e246927e4df admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.824581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0036fc-83ed-42eb-9313-1e246927e4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.827555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea6801-1469-41f6-b3df-8961cf0e9c1d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.828283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0036fc-83ed-42eb-9313-1e246927e4df admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.829067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b4ea6801-1469-41f6-b3df-8961cf0e9c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:32.855508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1086/2157] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:32.857047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0036fc-83ed-42eb-9313-1e246927e4df admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.871211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0036fc-83ed-42eb-9313-1e246927e4df admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.876595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef96e1-bbc3-45f8-bf0d-de6246c72f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.877377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef96e1-bbc3-45f8-bf0d-de6246c72f06 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.878028 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef96e1-bbc3-45f8-bf0d-de6246c72f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.878434 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef96e1-bbc3-45f8-bf0d-de6246c72f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.879266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef96e1-bbc3-45f8-bf0d-de6246c72f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.881783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef96e1-bbc3-45f8-bf0d-de6246c72f06 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.892955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1087/2158] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:32.896999 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef96e1-bbc3-45f8-bf0d-de6246c72f06 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:32.909203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef96e1-bbc3-45f8-bf0d-de6246c72f06 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.916160 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea6801-1469-41f6-b3df-8961cf0e9c1d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:32.916718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65950135-0aca-48bd-884c-0800b3e84ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.917921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65950135-0aca-48bd-884c-0800b3e84ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.918348 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65950135-0aca-48bd-884c-0800b3e84ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.918743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65950135-0aca-48bd-884c-0800b3e84ee0 admin admin] PATH_INFO: `/v3/projects/77b908d3f3e9403e8988e6d5417d5b5f/users/5b5202e7cdef48dfb83b7712be741c9a/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.925175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60e7d5-a747-4a40-821f-7742392edcb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:32.926462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60e7d5-a747-4a40-821f-7742392edcb9 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.927791 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60e7d5-a747-4a40-821f-7742392edcb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.928262 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60e7d5-a747-4a40-821f-7742392edcb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.939066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60e7d5-a747-4a40-821f-7742392edcb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.939288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65950135-0aca-48bd-884c-0800b3e84ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b908d3f3e9403e8988e6d5417d5b5f, user_id=5b5202e7cdef48dfb83b7712be741c9a, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:32.940881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60e7d5-a747-4a40-821f-7742392edcb9 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.942355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65950135-0aca-48bd-884c-0800b3e84ee0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:32.953164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1072/2159] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:32.958395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1088/2160] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:32 2022] PUT /identity/v3/projects/77b908d3f3e9403e8988e6d5417d5b5f/users/5b5202e7cdef48dfb83b7712be741c9a/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:32.972000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4ae3a-9a8f-4345-935b-b126701f7dba None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:32.972526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4ae3a-9a8f-4345-935b-b126701f7dba None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:32.972804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4ae3a-9a8f-4345-935b-b126701f7dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:32.976362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65950135-0aca-48bd-884c-0800b3e84ee0 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.002259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d8b4ae3a-9a8f-4345-935b-b126701f7dba None None] MFA Rules not processed for user `5b5202e7cdef48dfb83b7712be741c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:33.003351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d8b4ae3a-9a8f-4345-935b-b126701f7dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.054286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65950135-0aca-48bd-884c-0800b3e84ee0 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.061588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.062731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.063014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.063288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] PATH_INFO: `/v3/users/fbb0bff436264967ad1407ef90f9cde6` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.064575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb0bff436264967ad1407ef90f9cde6)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.066845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:33.086325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1073/2161] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:33.092030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4ae3a-9a8f-4345-935b-b126701f7dba None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.106537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4ae3a-9a8f-4345-935b-b126701f7dba None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.114104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0183d5-2e43-4cce-89ac-4fee5ee21ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.114799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0183d5-2e43-4cce-89ac-4fee5ee21ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.115056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0183d5-2e43-4cce-89ac-4fee5ee21ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.115439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0183d5-2e43-4cce-89ac-4fee5ee21ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.116015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0183d5-2e43-4cce-89ac-4fee5ee21ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.118070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0183d5-2e43-4cce-89ac-4fee5ee21ef0 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:33.130656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb0bff436264967ad1407ef90f9cde6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.144867 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb0bff436264967ad1407ef90f9cde6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.145566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb0bff436264967ad1407ef90f9cde6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.149565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1074/2162] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:33 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:33.149682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb0bff436264967ad1407ef90f9cde6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.150557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0183d5-2e43-4cce-89ac-4fee5ee21ef0 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.152713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9f0183d5-2e43-4cce-89ac-4fee5ee21ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.155805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-11508833-d543-43ac-a8b7-a16e2862fb95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb0bff436264967ad1407ef90f9cde6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.170565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1089/2163] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:32 2022] DELETE /identity/v3/users/fbb0bff436264967ad1407ef90f9cde6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:33.177462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636edd1-d8ed-407c-8ea8-d8c2b8f1d20a None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.177867 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636edd1-d8ed-407c-8ea8-d8c2b8f1d20a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.178520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636edd1-d8ed-407c-8ea8-d8c2b8f1d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.204499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-3636edd1-d8ed-407c-8ea8-d8c2b8f1d20a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:33.205848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3636edd1-d8ed-407c-8ea8-d8c2b8f1d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.227520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0183d5-2e43-4cce-89ac-4fee5ee21ef0 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.274401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1090/2164] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:33.284433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636edd1-d8ed-407c-8ea8-d8c2b8f1d20a None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.286217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3636edd1-d8ed-407c-8ea8-d8c2b8f1d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.290335 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea0f7-8814-486b-a400-42ce91b64485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.291015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea0f7-8814-486b-a400-42ce91b64485 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.291281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea0f7-8814-486b-a400-42ce91b64485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.291717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea0f7-8814-486b-a400-42ce91b64485 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.292415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ea0f7-8814-486b-a400-42ce91b64485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.306352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ea0f7-8814-486b-a400-42ce91b64485 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:33.320054 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1075/2165] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:33 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:33.324279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea0f7-8814-486b-a400-42ce91b64485 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.340723 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea0f7-8814-486b-a400-42ce91b64485 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.344273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d310a9-98c7-4e06-a4a3-270a757f1624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.345088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d310a9-98c7-4e06-a4a3-270a757f1624 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.345434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d310a9-98c7-4e06-a4a3-270a757f1624 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.345777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d310a9-98c7-4e06-a4a3-270a757f1624 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.346723 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d310a9-98c7-4e06-a4a3-270a757f1624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.348288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d310a9-98c7-4e06-a4a3-270a757f1624 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:33.350041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636edd1-d8ed-407c-8ea8-d8c2b8f1d20a None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.354154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f19f9-c58d-4975-8014-d62733033a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.354812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f19f9-c58d-4975-8014-d62733033a0b service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.355090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f19f9-c58d-4975-8014-d62733033a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.355367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f19f9-c58d-4975-8014-d62733033a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.359397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1076/2166] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:33.364156 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d310a9-98c7-4e06-a4a3-270a757f1624 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.368723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f19f9-c58d-4975-8014-d62733033a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.370799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f19f9-c58d-4975-8014-d62733033a0b service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:33.374428 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d310a9-98c7-4e06-a4a3-270a757f1624 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.379605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98385ae3-160e-47e5-96c4-86353f224827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.380525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385ae3-160e-47e5-96c4-86353f224827 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.380808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385ae3-160e-47e5-96c4-86353f224827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.381084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385ae3-160e-47e5-96c4-86353f224827 admin admin] PATH_INFO: `/v3/projects/89bdcef248164a079542939fa93bb972/users/c1a42aaa53a24916a23823d4805af345/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.381563 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1091/2167] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:33.405249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98385ae3-160e-47e5-96c4-86353f224827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bdcef248164a079542939fa93bb972, user_id=c1a42aaa53a24916a23823d4805af345, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.408426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98385ae3-160e-47e5-96c4-86353f224827 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:33.424239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1077/2168] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:33 2022] PUT /identity/v3/projects/89bdcef248164a079542939fa93bb972/users/c1a42aaa53a24916a23823d4805af345/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:33.428651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f19f9-c58d-4975-8014-d62733033a0b service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.439365 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f19f9-c58d-4975-8014-d62733033a0b service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.497917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848a988-42fd-4772-98a7-172e12075099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.498705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848a988-42fd-4772-98a7-172e12075099 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.498982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848a988-42fd-4772-98a7-172e12075099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.499391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848a988-42fd-4772-98a7-172e12075099 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.500217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848a988-42fd-4772-98a7-172e12075099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.502068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848a988-42fd-4772-98a7-172e12075099 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:33.512474 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1092/2169] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:33.516794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98385ae3-160e-47e5-96c4-86353f224827 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.527222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98385ae3-160e-47e5-96c4-86353f224827 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.532274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5221f-d20c-4771-ac19-c86647744841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.533190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5221f-d20c-4771-ac19-c86647744841 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.533664 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5221f-d20c-4771-ac19-c86647744841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.533825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5221f-d20c-4771-ac19-c86647744841 admin admin] PATH_INFO: `/v3/projects/89bdcef248164a079542939fa93bb972/users/c1a42aaa53a24916a23823d4805af345/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.536249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5221f-d20c-4771-ac19-c86647744841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bdcef248164a079542939fa93bb972, user_id=c1a42aaa53a24916a23823d4805af345, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.538988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5221f-d20c-4771-ac19-c86647744841 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:33.551620 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1078/2170] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:33 2022] PUT /identity/v3/projects/89bdcef248164a079542939fa93bb972/users/c1a42aaa53a24916a23823d4805af345/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:33.563158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab4b3-5ca0-4433-a2e3-d26a9f713cc3 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.563454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab4b3-5ca0-4433-a2e3-d26a9f713cc3 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.563713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab4b3-5ca0-4433-a2e3-d26a9f713cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.596903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-620ab4b3-5ca0-4433-a2e3-d26a9f713cc3 None None] MFA Rules not processed for user `c1a42aaa53a24916a23823d4805af345`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:33.598157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-620ab4b3-5ca0-4433-a2e3-d26a9f713cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.639429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5221f-d20c-4771-ac19-c86647744841 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.641534 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b1e5221f-d20c-4771-ac19-c86647744841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.690155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1093/2171] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:33.701320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ab4b3-5ca0-4433-a2e3-d26a9f713cc3 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.703028 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-620ab4b3-5ca0-4433-a2e3-d26a9f713cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.722538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5221f-d20c-4771-ac19-c86647744841 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.729709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.730657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.730939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.731219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] PATH_INFO: `/v3/users/be8c2f084592458397d507e599887002` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.732464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8c2f084592458397d507e599887002)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.734488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:33.780481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ab4b3-5ca0-4433-a2e3-d26a9f713cc3 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.781331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8c2f084592458397d507e599887002'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.785010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.786278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.786559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.786835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] PATH_INFO: `/v3/projects/4595909c2afd467c8bb87711e754fefc` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.788017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4595909c2afd467c8bb87711e754fefc)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.789924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:33.793680 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8c2f084592458397d507e599887002'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.794395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8c2f084592458397d507e599887002'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.802903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8c2f084592458397d507e599887002'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.803516 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8c2f084592458397d507e599887002'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.816775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1079/2172] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:33 2022] DELETE /identity/v3/users/be8c2f084592458397d507e599887002 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:33.819134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.820862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.836016 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4595909c2afd467c8bb87711e754fefc', 'request_id': 'req-bafccfe0-d675-4a6b-9b96-c66a057f836a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.842224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4595909c2afd467c8bb87711e754fefc', 'request_id': 'req-bafccfe0-d675-4a6b-9b96-c66a057f836a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.850146 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4595909c2afd467c8bb87711e754fefc', 'request_id': 'req-bafccfe0-d675-4a6b-9b96-c66a057f836a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.860446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] The token cache is being invalidate because project 4595909c2afd467c8bb87711e754fefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:33.860726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.861352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bafccfe0-d675-4a6b-9b96-c66a057f836a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:33.866649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1094/2173] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:33 2022] DELETE /identity/v3/projects/4595909c2afd467c8bb87711e754fefc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:33.866649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da891350-2ba3-4e1a-ab16-7aa14131babc None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.866649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da891350-2ba3-4e1a-ab16-7aa14131babc None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.866649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da891350-2ba3-4e1a-ab16-7aa14131babc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.876875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6df54-022a-407a-8709-041904b174ea admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:33.885110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-da891350-2ba3-4e1a-ab16-7aa14131babc None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:33.886373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-da891350-2ba3-4e1a-ab16-7aa14131babc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.928381 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d03113-e034-479c-906e-4ca4a7058ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:33.928948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d03113-e034-479c-906e-4ca4a7058ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.929255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d03113-e034-479c-906e-4ca4a7058ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.929496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d03113-e034-479c-906e-4ca4a7058ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.931388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-00d03113-e034-479c-906e-4ca4a7058ef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.945497 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1095/2174] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:33.946821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cdd34-b702-4668-b269-09dae38c656d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:33.947101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cdd34-b702-4668-b269-09dae38c656d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:33.947372 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cdd34-b702-4668-b269-09dae38c656d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:33.969031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-769cdd34-b702-4668-b269-09dae38c656d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:33.970387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-769cdd34-b702-4668-b269-09dae38c656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.978661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1096/2175] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:33.985887 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cdd34-b702-4668-b269-09dae38c656d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:33.987331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-769cdd34-b702-4668-b269-09dae38c656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:33.995280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d03113-e034-479c-906e-4ca4a7058ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:33.996733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d03113-e034-479c-906e-4ca4a7058ef2 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.006311 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1080/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:34.007655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743a32f-e425-4074-aeb4-8ad5a1a35456 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.007938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743a32f-e425-4074-aeb4-8ad5a1a35456 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.008454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743a32f-e425-4074-aeb4-8ad5a1a35456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.045425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d743a32f-e425-4074-aeb4-8ad5a1a35456 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:34.048597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d743a32f-e425-4074-aeb4-8ad5a1a35456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:34.070635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cdd34-b702-4668-b269-09dae38c656d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:34.074408 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106486a8-85d1-4879-bb3c-400213e506d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:34.075070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106486a8-85d1-4879-bb3c-400213e506d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.075501 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106486a8-85d1-4879-bb3c-400213e506d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.075612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106486a8-85d1-4879-bb3c-400213e506d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.078218 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1081/2177] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:34.080556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743a32f-e425-4074-aeb4-8ad5a1a35456 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:34.088083 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106486a8-85d1-4879-bb3c-400213e506d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:34.090403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106486a8-85d1-4879-bb3c-400213e506d2 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.092194 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743a32f-e425-4074-aeb4-8ad5a1a35456 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:34.102754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1097/2178] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:34.104621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463c5e4-b695-47ac-bfcb-7735187477d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:34.105716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c5e4-b695-47ac-bfcb-7735187477d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.106011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c5e4-b695-47ac-bfcb-7735187477d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.106313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c5e4-b695-47ac-bfcb-7735187477d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.107199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463c5e4-b695-47ac-bfcb-7735187477d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:34.107509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463c5e4-b695-47ac-bfcb-7735187477d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:34.109220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463c5e4-b695-47ac-bfcb-7735187477d7 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.128886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1082/2179] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:53:34.129674 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106486a8-85d1-4879-bb3c-400213e506d2 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:34.140262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106486a8-85d1-4879-bb3c-400213e506d2 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:34.145859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec599d64-88e6-434a-8846-b65bf292135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:34.146797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec599d64-88e6-434a-8846-b65bf292135e admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.147229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec599d64-88e6-434a-8846-b65bf292135e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.147503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec599d64-88e6-434a-8846-b65bf292135e admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.148202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec599d64-88e6-434a-8846-b65bf292135e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:34.150182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec599d64-88e6-434a-8846-b65bf292135e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.195412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1098/2180] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:34 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:34.199821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463c5e4-b695-47ac-bfcb-7735187477d7 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:34.210675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463c5e4-b695-47ac-bfcb-7735187477d7 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:34.311329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ccc2b-5eac-40b8-853a-d66ab51cd8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:34.312130 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ccc2b-5eac-40b8-853a-d66ab51cd8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.312575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ccc2b-5eac-40b8-853a-d66ab51cd8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.313025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ccc2b-5eac-40b8-853a-d66ab51cd8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.313838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ccc2b-5eac-40b8-853a-d66ab51cd8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:34.316068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ccc2b-5eac-40b8-853a-d66ab51cd8c1 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.356506 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1083/2181] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:34 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:34.358543 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec599d64-88e6-434a-8846-b65bf292135e admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:34.373816 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec599d64-88e6-434a-8846-b65bf292135e admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:34.387732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bb446-8646-4571-bf3c-3e9e0295e18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:34.387732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bb446-8646-4571-bf3c-3e9e0295e18b admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.388078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bb446-8646-4571-bf3c-3e9e0295e18b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.388624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bb446-8646-4571-bf3c-3e9e0295e18b admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.389489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bb446-8646-4571-bf3c-3e9e0295e18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:34.392038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bb446-8646-4571-bf3c-3e9e0295e18b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.405962 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1099/2182] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:34.411472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ccc2b-5eac-40b8-853a-d66ab51cd8c1 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:34.459704 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ccc2b-5eac-40b8-853a-d66ab51cd8c1 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:34.470728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042fa7d-1a30-498c-869b-8e1431a91e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:34.471051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bb446-8646-4571-bf3c-3e9e0295e18b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:34.471417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042fa7d-1a30-498c-869b-8e1431a91e4b admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.471693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042fa7d-1a30-498c-869b-8e1431a91e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.472143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042fa7d-1a30-498c-869b-8e1431a91e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.472885 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042fa7d-1a30-498c-869b-8e1431a91e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:34.473736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d10bb446-8646-4571-bf3c-3e9e0295e18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:34.476889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042fa7d-1a30-498c-869b-8e1431a91e4b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.508787 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1084/2183] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:34.511087 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042fa7d-1a30-498c-869b-8e1431a91e4b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:34.521558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042fa7d-1a30-498c-869b-8e1431a91e4b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:34.524956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bb446-8646-4571-bf3c-3e9e0295e18b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:34.527056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3d05c-bb10-4c25-9412-0e90b5dc31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:34.528103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d05c-bb10-4c25-9412-0e90b5dc31ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.528375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d05c-bb10-4c25-9412-0e90b5dc31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.528650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d05c-bb10-4c25-9412-0e90b5dc31ae admin admin] PATH_INFO: `/v3/projects/2f4f538802af4de58bbfe8714c2554c6/users/344aff0b446f4ef6b5af5ecffcd5777e/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.532745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:34.533620 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.534050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.534306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] PATH_INFO: `/v3/projects/1927b06de67f459398bed7592dea43fd` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.536192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1927b06de67f459398bed7592dea43fd)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:34.538764 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.557298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3d05c-bb10-4c25-9412-0e90b5dc31ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4f538802af4de58bbfe8714c2554c6, user_id=344aff0b446f4ef6b5af5ecffcd5777e, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:34.560061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3d05c-bb10-4c25-9412-0e90b5dc31ae admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.588241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1085/2184] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:34 2022] PUT /identity/v3/projects/2f4f538802af4de58bbfe8714c2554c6/users/344aff0b446f4ef6b5af5ecffcd5777e/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:34.604396 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc464d18-063e-4f18-ab91-fb269ff60359 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.605133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc464d18-063e-4f18-ab91-fb269ff60359 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.605733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc464d18-063e-4f18-ab91-fb269ff60359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.614526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1927b06de67f459398bed7592dea43fd', 'request_id': 'req-9aac946f-048e-49f3-9db7-915536f2949a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:34.621478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1927b06de67f459398bed7592dea43fd', 'request_id': 'req-9aac946f-048e-49f3-9db7-915536f2949a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:34.631842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1927b06de67f459398bed7592dea43fd', 'request_id': 'req-9aac946f-048e-49f3-9db7-915536f2949a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:34.639243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-cc464d18-063e-4f18-ab91-fb269ff60359 None None] MFA Rules not processed for user `344aff0b446f4ef6b5af5ecffcd5777e`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:34.640641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cc464d18-063e-4f18-ab91-fb269ff60359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:34.645733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] The token cache is being invalidate because project 1927b06de67f459398bed7592dea43fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:34.646590 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:34.646850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:34.648898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1100/2185] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:34 2022] DELETE /identity/v3/projects/1927b06de67f459398bed7592dea43fd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:34.652915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:34.654293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:34.730413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac946f-048e-49f3-9db7-915536f2949a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:34.732180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1086/2186] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:34.739442 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:34.740552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.740913 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.741276 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] PATH_INFO: `/v3/users/2ece96e25ef94ba0a96ab5c5f28106fa` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.742655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ece96e25ef94ba0a96ab5c5f28106fa)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:34.744299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc464d18-063e-4f18-ab91-fb269ff60359 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:34.744861 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.745602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cc464d18-063e-4f18-ab91-fb269ff60359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:34.798956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ece96e25ef94ba0a96ab5c5f28106fa'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:34.806553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc464d18-063e-4f18-ab91-fb269ff60359 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:34.810204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b24e1-0f6a-4224-9f5b-b9a87d2cfabb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:34.810942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b24e1-0f6a-4224-9f5b-b9a87d2cfabb service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:34.811123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b24e1-0f6a-4224-9f5b-b9a87d2cfabb service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:34.811396 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b24e1-0f6a-4224-9f5b-b9a87d2cfabb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:34.826510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ece96e25ef94ba0a96ab5c5f28106fa'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:34.826728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b24e1-0f6a-4224-9f5b-b9a87d2cfabb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:34.827729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ece96e25ef94ba0a96ab5c5f28106fa'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:34.828313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b24e1-0f6a-4224-9f5b-b9a87d2cfabb service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:34.829530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ece96e25ef94ba0a96ab5c5f28106fa'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:34.838373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ece96e25ef94ba0a96ab5c5f28106fa'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:34.839015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1087/2187] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:34.852199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1101/2188] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:34 2022] DELETE /identity/v3/users/2ece96e25ef94ba0a96ab5c5f28106fa => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:35.169515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b24e1-0f6a-4224-9f5b-b9a87d2cfabb service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:35.184551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b24e1-0f6a-4224-9f5b-b9a87d2cfabb service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:35.253303 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:35.254117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:35.254400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:35.254670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] PATH_INFO: `/v3/projects/2edddd3f3c62492ab3f2eb7715bd848f` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:35.255849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2edddd3f3c62492ab3f2eb7715bd848f)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:35.257898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:35.304291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2edddd3f3c62492ab3f2eb7715bd848f', 'request_id': 'req-ea35cdee-c647-4a23-9f73-f1e07d20852e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.310383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2edddd3f3c62492ab3f2eb7715bd848f', 'request_id': 'req-ea35cdee-c647-4a23-9f73-f1e07d20852e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.318433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2edddd3f3c62492ab3f2eb7715bd848f', 'request_id': 'req-ea35cdee-c647-4a23-9f73-f1e07d20852e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.328383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] The token cache is being invalidate because project 2edddd3f3c62492ab3f2eb7715bd848f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:35.328681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.329299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.330956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1088/2189] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:35 2022] DELETE /identity/v3/projects/2edddd3f3c62492ab3f2eb7715bd848f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:35.335289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:35.336745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:35.349658 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed992b-53c4-4b06-9d06-1a1e81e48e6d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:35.417395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:35.418716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:35.419124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:35.419596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] PATH_INFO: `/v3/users/fc654b9cd97b4e42ab9f74251c4a20b3` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:35.421504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc654b9cd97b4e42ab9f74251c4a20b3)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:35.423548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:35.471339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc654b9cd97b4e42ab9f74251c4a20b3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.483855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc654b9cd97b4e42ab9f74251c4a20b3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.484565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc654b9cd97b4e42ab9f74251c4a20b3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.485159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc654b9cd97b4e42ab9f74251c4a20b3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.492959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d37974f2-2150-4a80-9ae4-d6dce8f62c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc654b9cd97b4e42ab9f74251c4a20b3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.505317 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1102/2190] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:35 2022] DELETE /identity/v3/users/fc654b9cd97b4e42ab9f74251c4a20b3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:35.806860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:35.808251 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:35.821090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35cdee-c647-4a23-9f73-f1e07d20852e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:35.887066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:35.887947 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:35.888223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:35.888580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] PATH_INFO: `/v3/projects/b5c75cd1ee1e43f0b000aa54cd8fa395` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:35.889707 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c75cd1ee1e43f0b000aa54cd8fa395)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:35.891727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:35.943945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c75cd1ee1e43f0b000aa54cd8fa395', 'request_id': 'req-6fdd3d21-4f70-4244-9277-20f7f68b74ed'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.954001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c75cd1ee1e43f0b000aa54cd8fa395', 'request_id': 'req-6fdd3d21-4f70-4244-9277-20f7f68b74ed'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.968873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c75cd1ee1e43f0b000aa54cd8fa395', 'request_id': 'req-6fdd3d21-4f70-4244-9277-20f7f68b74ed'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.981505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] The token cache is being invalidate because project b5c75cd1ee1e43f0b000aa54cd8fa395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:35.981823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.982502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6fdd3d21-4f70-4244-9277-20f7f68b74ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:35.984382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1089/2191] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:35 2022] DELETE /identity/v3/projects/b5c75cd1ee1e43f0b000aa54cd8fa395 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:35.990983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1738a-1bc1-49f6-89f1-7d9a9451524d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:35.991188 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1738a-1bc1-49f6-89f1-7d9a9451524d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:35.991470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1738a-1bc1-49f6-89f1-7d9a9451524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.009493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-8bf1738a-1bc1-49f6-89f1-7d9a9451524d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:36.010740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8bf1738a-1bc1-49f6-89f1-7d9a9451524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:36.090120 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1103/2192] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:36.095211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7737883-7e95-433b-a7d9-06785436e7c5 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.095497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7737883-7e95-433b-a7d9-06785436e7c5 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.095774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7737883-7e95-433b-a7d9-06785436e7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.114010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c7737883-7e95-433b-a7d9-06785436e7c5 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:36.115328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c7737883-7e95-433b-a7d9-06785436e7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:36.123186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1090/2193] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:36.128736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1738a-1bc1-49f6-89f1-7d9a9451524d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.137359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1738a-1bc1-49f6-89f1-7d9a9451524d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.142107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f666ddd-ace3-4259-8172-e5507d65a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.142777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f666ddd-ace3-4259-8172-e5507d65a921 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.143061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f666ddd-ace3-4259-8172-e5507d65a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.143331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f666ddd-ace3-4259-8172-e5507d65a921 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.144081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f666ddd-ace3-4259-8172-e5507d65a921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:36.144386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f666ddd-ace3-4259-8172-e5507d65a921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.146006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f666ddd-ace3-4259-8172-e5507d65a921 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:36.158004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1104/2194] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:36.162639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7737883-7e95-433b-a7d9-06785436e7c5 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.172157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7737883-7e95-433b-a7d9-06785436e7c5 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.178661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68107882-1d46-466f-a8e5-0dc488c0ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.179364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68107882-1d46-466f-a8e5-0dc488c0ce62 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.179647 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68107882-1d46-466f-a8e5-0dc488c0ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.180121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68107882-1d46-466f-a8e5-0dc488c0ce62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.180837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68107882-1d46-466f-a8e5-0dc488c0ce62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.182862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68107882-1d46-466f-a8e5-0dc488c0ce62 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:36.222887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1091/2195] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:36 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:36.223928 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f666ddd-ace3-4259-8172-e5507d65a921 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.234502 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f666ddd-ace3-4259-8172-e5507d65a921 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.272423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68107882-1d46-466f-a8e5-0dc488c0ce62 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.274241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-68107882-1d46-466f-a8e5-0dc488c0ce62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:36.300250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38a14a-7ff1-4943-80d0-82f7ccadb718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.301362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a14a-7ff1-4943-80d0-82f7ccadb718 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.302052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a14a-7ff1-4943-80d0-82f7ccadb718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.302385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a14a-7ff1-4943-80d0-82f7ccadb718 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.303490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38a14a-7ff1-4943-80d0-82f7ccadb718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.306527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38a14a-7ff1-4943-80d0-82f7ccadb718 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:36.334959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1105/2196] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:36 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:36.336679 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38a14a-7ff1-4943-80d0-82f7ccadb718 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.348816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68107882-1d46-466f-a8e5-0dc488c0ce62 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.351612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38a14a-7ff1-4943-80d0-82f7ccadb718 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.354113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.355300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.355581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.355851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] PATH_INFO: `/v3/users/5cb4c3edd8524c299d868cc4eddeae7c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.357414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb4c3edd8524c299d868cc4eddeae7c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.359587 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:36.370955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13669a48-2a4b-4053-8def-c5686ff70025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.371642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13669a48-2a4b-4053-8def-c5686ff70025 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.371925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13669a48-2a4b-4053-8def-c5686ff70025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.372345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13669a48-2a4b-4053-8def-c5686ff70025 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.373085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13669a48-2a4b-4053-8def-c5686ff70025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.386315 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13669a48-2a4b-4053-8def-c5686ff70025 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:36.412992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1106/2197] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:36.415206 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13669a48-2a4b-4053-8def-c5686ff70025 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.427061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13669a48-2a4b-4053-8def-c5686ff70025 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.432610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb099658-f0ac-457b-8a40-6b6d916e76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.433288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb099658-f0ac-457b-8a40-6b6d916e76e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.433581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb099658-f0ac-457b-8a40-6b6d916e76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.433858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb099658-f0ac-457b-8a40-6b6d916e76e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.434630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb099658-f0ac-457b-8a40-6b6d916e76e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.436242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb099658-f0ac-457b-8a40-6b6d916e76e5 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:36.446921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb4c3edd8524c299d868cc4eddeae7c'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:36.449377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1107/2198] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:36.453661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb099658-f0ac-457b-8a40-6b6d916e76e5 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.461173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb4c3edd8524c299d868cc4eddeae7c'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:36.461749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb4c3edd8524c299d868cc4eddeae7c'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:36.464123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb099658-f0ac-457b-8a40-6b6d916e76e5 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.470435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a73c3d-7df1-4c0d-b41f-43e44e6038e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.470589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb4c3edd8524c299d868cc4eddeae7c'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:36.471216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-90f9331a-4caf-46d7-8a40-e41e0b01445a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb4c3edd8524c299d868cc4eddeae7c'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:36.471428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73c3d-7df1-4c0d-b41f-43e44e6038e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.471787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73c3d-7df1-4c0d-b41f-43e44e6038e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.472069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73c3d-7df1-4c0d-b41f-43e44e6038e2 admin admin] PATH_INFO: `/v3/projects/37c9db6cc9ff4036a092c91138e6c6b3/users/743564ffbc354c85814a07001a3c387e/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.487333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1092/2199] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:36 2022] DELETE /identity/v3/users/5cb4c3edd8524c299d868cc4eddeae7c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:36.488440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a73c3d-7df1-4c0d-b41f-43e44e6038e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c9db6cc9ff4036a092c91138e6c6b3, user_id=743564ffbc354c85814a07001a3c387e, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.488970 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dd14b-a166-44eb-a28d-230c0ab792e6 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.489259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dd14b-a166-44eb-a28d-230c0ab792e6 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.489584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dd14b-a166-44eb-a28d-230c0ab792e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.491457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a73c3d-7df1-4c0d-b41f-43e44e6038e2 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:36.506280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1108/2200] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:36 2022] PUT /identity/v3/projects/37c9db6cc9ff4036a092c91138e6c6b3/users/743564ffbc354c85814a07001a3c387e/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:36.508897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ba4dd14b-a166-44eb-a28d-230c0ab792e6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:36.510224 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ba4dd14b-a166-44eb-a28d-230c0ab792e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:36.511129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d022737-df6f-4076-956b-3d6ac08c0e8d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.511452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d022737-df6f-4076-956b-3d6ac08c0e8d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.511727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d022737-df6f-4076-956b-3d6ac08c0e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.527889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-3d022737-df6f-4076-956b-3d6ac08c0e8d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:36.529109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3d022737-df6f-4076-956b-3d6ac08c0e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:36.567217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1093/2201] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:36.577410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dd14b-a166-44eb-a28d-230c0ab792e6 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.579247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ba4dd14b-a166-44eb-a28d-230c0ab792e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:36.589293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1109/2202] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:36.596843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d022737-df6f-4076-956b-3d6ac08c0e8d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.598437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3d022737-df6f-4076-956b-3d6ac08c0e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:36.640202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dd14b-a166-44eb-a28d-230c0ab792e6 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.644038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0ea34-d3cd-41b6-875a-a2b5a00a8e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.644712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0ea34-d3cd-41b6-875a-a2b5a00a8e78 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.645000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0ea34-d3cd-41b6-875a-a2b5a00a8e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.645260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0ea34-d3cd-41b6-875a-a2b5a00a8e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.654717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0ea34-d3cd-41b6-875a-a2b5a00a8e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.656296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0ea34-d3cd-41b6-875a-a2b5a00a8e78 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:36.665219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d022737-df6f-4076-956b-3d6ac08c0e8d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.666256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1094/2203] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:36.669031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ae03f-ed81-4421-95fc-af74623b5376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.669828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ae03f-ed81-4421-95fc-af74623b5376 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.670213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ae03f-ed81-4421-95fc-af74623b5376 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.670558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ae03f-ed81-4421-95fc-af74623b5376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.680096 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ae03f-ed81-4421-95fc-af74623b5376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.681571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ae03f-ed81-4421-95fc-af74623b5376 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:36.692530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1110/2204] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:36.704505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0ea34-d3cd-41b6-875a-a2b5a00a8e78 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.705978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-22f0ea34-d3cd-41b6-875a-a2b5a00a8e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:36.719019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0ea34-d3cd-41b6-875a-a2b5a00a8e78 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.723965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.724845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.725126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.725397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] PATH_INFO: `/v3/users/5b5202e7cdef48dfb83b7712be741c9a` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.726818 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5202e7cdef48dfb83b7712be741c9a)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.728948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:36.777294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5202e7cdef48dfb83b7712be741c9a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:36.789805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5202e7cdef48dfb83b7712be741c9a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:36.790640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5202e7cdef48dfb83b7712be741c9a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:36.799523 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5202e7cdef48dfb83b7712be741c9a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:36.800177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5202e7cdef48dfb83b7712be741c9a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:36.814369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1095/2205] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:36 2022] DELETE /identity/v3/users/5b5202e7cdef48dfb83b7712be741c9a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:36.819493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1589a-4368-450b-8352-98884c78884a None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.819913 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1589a-4368-450b-8352-98884c78884a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.820379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1589a-4368-450b-8352-98884c78884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.838860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-9ce1589a-4368-450b-8352-98884c78884a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:36.840035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9ce1589a-4368-450b-8352-98884c78884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:36.905452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1111/2206] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:36.916018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:36.917703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:36.976517 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8bcb3-ca33-4b31-8917-f65a7d715ece admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:36.980375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58415ea6-fd7a-4785-ad46-deb24bf03ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:36.981030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58415ea6-fd7a-4785-ad46-deb24bf03ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:36.981308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58415ea6-fd7a-4785-ad46-deb24bf03ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:36.981582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58415ea6-fd7a-4785-ad46-deb24bf03ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:36.991454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58415ea6-fd7a-4785-ad46-deb24bf03ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:36.992896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58415ea6-fd7a-4785-ad46-deb24bf03ad3 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:37.003084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1096/2207] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:37.159892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1589a-4368-450b-8352-98884c78884a None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:37.161837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9ce1589a-4368-450b-8352-98884c78884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:37.179692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58415ea6-fd7a-4785-ad46-deb24bf03ad3 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:37.181360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-58415ea6-fd7a-4785-ad46-deb24bf03ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:37.197505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58415ea6-fd7a-4785-ad46-deb24bf03ad3 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:37.207409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:37.210746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:37.211254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:37.211837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] PATH_INFO: `/v3/projects/63151e803e50473b83d6d880baa3f359` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:37.214333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63151e803e50473b83d6d880baa3f359)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:37.216600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:37.292148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1589a-4368-450b-8352-98884c78884a None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:37.316141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63151e803e50473b83d6d880baa3f359', 'request_id': 'req-25705fe4-aaf4-4fe0-9aca-64968677a565'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.330247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63151e803e50473b83d6d880baa3f359', 'request_id': 'req-25705fe4-aaf4-4fe0-9aca-64968677a565'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.342015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63151e803e50473b83d6d880baa3f359', 'request_id': 'req-25705fe4-aaf4-4fe0-9aca-64968677a565'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.356710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] The token cache is being invalidate because project 63151e803e50473b83d6d880baa3f359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:37.357708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.366452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21f9e6-0ab3-470c-8957-99dfdee5b8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:37.368100 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f9e6-0ab3-470c-8957-99dfdee5b8ac service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:37.369029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f9e6-0ab3-470c-8957-99dfdee5b8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:37.369579 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f9e6-0ab3-470c-8957-99dfdee5b8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:37.370069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.371843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1097/2208] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:37 2022] DELETE /identity/v3/projects/63151e803e50473b83d6d880baa3f359 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:37.372219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1f21f9e6-0ab3-470c-8957-99dfdee5b8ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:37.373798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:37.375706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:37.444801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25705fe4-aaf4-4fe0-9aca-64968677a565 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:37.450110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:37.451088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:37.451366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:37.451673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] PATH_INFO: `/v3/projects/77b908d3f3e9403e8988e6d5417d5b5f` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:37.452922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b908d3f3e9403e8988e6d5417d5b5f)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:37.454897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:37.461941 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21f9e6-0ab3-470c-8957-99dfdee5b8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:37.463596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21f9e6-0ab3-470c-8957-99dfdee5b8ac service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:37.474117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1112/2209] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:37.474999 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21f9e6-0ab3-470c-8957-99dfdee5b8ac service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:37.476361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1f21f9e6-0ab3-470c-8957-99dfdee5b8ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:37.490291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21f9e6-0ab3-470c-8957-99dfdee5b8ac service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:37.497596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:37.498751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:37.499125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:37.499657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] PATH_INFO: `/v3/users/b5f5ec11d9be498288f1d628cc72d2ed` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:37.501201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f5ec11d9be498288f1d628cc72d2ed)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:37.516814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:37.532583 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b908d3f3e9403e8988e6d5417d5b5f', 'request_id': 'req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.542468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b908d3f3e9403e8988e6d5417d5b5f', 'request_id': 'req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.560752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b908d3f3e9403e8988e6d5417d5b5f', 'request_id': 'req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.575333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] The token cache is being invalidate because project 77b908d3f3e9403e8988e6d5417d5b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:37.575333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.576203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.578308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1098/2210] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:37 2022] DELETE /identity/v3/projects/77b908d3f3e9403e8988e6d5417d5b5f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:37.582154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:37.583753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:37.615859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f5ec11d9be498288f1d628cc72d2ed'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.644099 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f5ec11d9be498288f1d628cc72d2ed'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.646583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f5ec11d9be498288f1d628cc72d2ed'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.648405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f5ec11d9be498288f1d628cc72d2ed'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.668234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f5ec11d9be498288f1d628cc72d2ed'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.689804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1113/2211] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:37 2022] DELETE /identity/v3/users/b5f5ec11d9be498288f1d628cc72d2ed => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:37.693341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc25f09-8e01-4b8c-a726-2a57328f2ca0 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:37.787039 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:37.788307 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:37.788790 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:37.789253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] PATH_INFO: `/v3/users/c1a42aaa53a24916a23823d4805af345` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:37.790965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a42aaa53a24916a23823d4805af345)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:37.793181 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:37.884043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a42aaa53a24916a23823d4805af345'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.897591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a42aaa53a24916a23823d4805af345'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.898096 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a42aaa53a24916a23823d4805af345'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.908402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a42aaa53a24916a23823d4805af345'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.909374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a42aaa53a24916a23823d4805af345'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:37.924644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1099/2212] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:37 2022] DELETE /identity/v3/users/c1a42aaa53a24916a23823d4805af345 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:38.318672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:38.320596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:38.329044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:38.330765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:38.344962 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406eee6-d328-4327-94b9-a3f1fc862d23 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:38.416121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d049b-c2b9-46c9-ae1b-3e749558c714 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:38.422725 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:38.424404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.424813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.425227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] PATH_INFO: `/v3/projects/89bdcef248164a079542939fa93bb972` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.426668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89bdcef248164a079542939fa93bb972)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:38.428834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:38.480263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:38.483073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.483506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.483991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] PATH_INFO: `/v3/projects/2f42330c479d45c895af9c3af4ba7393` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.485595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f42330c479d45c895af9c3af4ba7393)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:38.488013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:38.497528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89bdcef248164a079542939fa93bb972', 'request_id': 'req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:38.504916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89bdcef248164a079542939fa93bb972', 'request_id': 'req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:38.514351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89bdcef248164a079542939fa93bb972', 'request_id': 'req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:38.528228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] The token cache is being invalidate because project 89bdcef248164a079542939fa93bb972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:38.528515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:38.529327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-04c9b1b9-cfd7-4f37-a684-54829e7a08f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:38.532369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1100/2213] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:38 2022] DELETE /identity/v3/projects/89bdcef248164a079542939fa93bb972 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:38.538972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad32294-3eee-4af4-9f76-75d14ca77aa8 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.539353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad32294-3eee-4af4-9f76-75d14ca77aa8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.539741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad32294-3eee-4af4-9f76-75d14ca77aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.553992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f42330c479d45c895af9c3af4ba7393', 'request_id': 'req-fc226244-8e27-4cdc-9b35-bb147e7001c8'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:38.560600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-bad32294-3eee-4af4-9f76-75d14ca77aa8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:38.562192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bad32294-3eee-4af4-9f76-75d14ca77aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:38.565467 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f42330c479d45c895af9c3af4ba7393', 'request_id': 'req-fc226244-8e27-4cdc-9b35-bb147e7001c8'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:38.582465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f42330c479d45c895af9c3af4ba7393', 'request_id': 'req-fc226244-8e27-4cdc-9b35-bb147e7001c8'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:38.600527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] The token cache is being invalidate because project 2f42330c479d45c895af9c3af4ba7393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:38.600896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:38.601565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fc226244-8e27-4cdc-9b35-bb147e7001c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:38.604307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1114/2214] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:38 2022] DELETE /identity/v3/projects/2f42330c479d45c895af9c3af4ba7393 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:38.618109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46c4dd-8836-4b1c-9f80-4e5981c7b273 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.618458 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46c4dd-8836-4b1c-9f80-4e5981c7b273 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.618876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46c4dd-8836-4b1c-9f80-4e5981c7b273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.635125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1101/2215] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:38.643460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222080-ce7a-48e3-b329-4992e25ced7b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.643803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222080-ce7a-48e3-b329-4992e25ced7b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.644098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222080-ce7a-48e3-b329-4992e25ced7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.665210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ae46c4dd-8836-4b1c-9f80-4e5981c7b273 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:38.666620 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ae46c4dd-8836-4b1c-9f80-4e5981c7b273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:38.680313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1115/2216] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:38.680520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-03222080-ce7a-48e3-b329-4992e25ced7b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:38.680520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-03222080-ce7a-48e3-b329-4992e25ced7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:38.683012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48ec79-03ca-479a-a046-fa3ed9b23018 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.683437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48ec79-03ca-479a-a046-fa3ed9b23018 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.683848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48ec79-03ca-479a-a046-fa3ed9b23018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.695378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1102/2217] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:38.700894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222080-ce7a-48e3-b329-4992e25ced7b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:38.706700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ac48ec79-03ca-479a-a046-fa3ed9b23018 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:38.707906 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ac48ec79-03ca-479a-a046-fa3ed9b23018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:38.715214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222080-ce7a-48e3-b329-4992e25ced7b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:38.720199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1116/2218] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:38.721178 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48ec79-03ca-479a-a046-fa3ed9b23018 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:38.724390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f1355-f213-4c26-842e-03c5f2f58b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:38.725437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f1355-f213-4c26-842e-03c5f2f58b5c admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.725863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f1355-f213-4c26-842e-03c5f2f58b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.726330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f1355-f213-4c26-842e-03c5f2f58b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.727227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f1355-f213-4c26-842e-03c5f2f58b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:38.727689 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f1355-f213-4c26-842e-03c5f2f58b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:38.729335 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f1355-f213-4c26-842e-03c5f2f58b5c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:38.731531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48ec79-03ca-479a-a046-fa3ed9b23018 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:38.737099 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a7322-f546-44e5-8c81-76e1f095e4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:38.738005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a7322-f546-44e5-8c81-76e1f095e4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.738332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a7322-f546-44e5-8c81-76e1f095e4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.738607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a7322-f546-44e5-8c81-76e1f095e4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.739356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a7322-f546-44e5-8c81-76e1f095e4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:38.739660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a7322-f546-44e5-8c81-76e1f095e4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:38.741645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a7322-f546-44e5-8c81-76e1f095e4e7 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:38.751005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1103/2219] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:38.758715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1117/2220] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:38.759686 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a7322-f546-44e5-8c81-76e1f095e4e7 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:38.760463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f1355-f213-4c26-842e-03c5f2f58b5c admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:38.769908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a7322-f546-44e5-8c81-76e1f095e4e7 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:38.775032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f00800-18fe-4c13-9b2e-3ec81751a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:38.775198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f1355-f213-4c26-842e-03c5f2f58b5c admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:38.776111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f00800-18fe-4c13-9b2e-3ec81751a82a admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.776598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f00800-18fe-4c13-9b2e-3ec81751a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.777086 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f00800-18fe-4c13-9b2e-3ec81751a82a admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.778002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f00800-18fe-4c13-9b2e-3ec81751a82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:38.779893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3cedf-cf47-4f32-9f59-a769bd91e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:38.780499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f00800-18fe-4c13-9b2e-3ec81751a82a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:38.782874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3cedf-cf47-4f32-9f59-a769bd91e33f admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.783212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3cedf-cf47-4f32-9f59-a769bd91e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.783487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3cedf-cf47-4f32-9f59-a769bd91e33f admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.784371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3cedf-cf47-4f32-9f59-a769bd91e33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:38.788891 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3cedf-cf47-4f32-9f59-a769bd91e33f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:38.845254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1104/2221] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:38 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:38.850740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3cedf-cf47-4f32-9f59-a769bd91e33f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:38.862170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1118/2222] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:38 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:38.862170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f00800-18fe-4c13-9b2e-3ec81751a82a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:38.967824 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3cedf-cf47-4f32-9f59-a769bd91e33f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:38.972624 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a959e0-6fd7-4033-967a-5b42373eb25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:38.975179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a959e0-6fd7-4033-967a-5b42373eb25d admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.975461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a959e0-6fd7-4033-967a-5b42373eb25d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.975735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a959e0-6fd7-4033-967a-5b42373eb25d admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.976444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a959e0-6fd7-4033-967a-5b42373eb25d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:38.979379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a959e0-6fd7-4033-967a-5b42373eb25d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:38.986255 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f00800-18fe-4c13-9b2e-3ec81751a82a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:38.991786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91980222-6e60-41d8-8217-6df35e48054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:38.992654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91980222-6e60-41d8-8217-6df35e48054b admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:38.992948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91980222-6e60-41d8-8217-6df35e48054b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:38.993305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91980222-6e60-41d8-8217-6df35e48054b admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:38.994536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91980222-6e60-41d8-8217-6df35e48054b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:38.996918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91980222-6e60-41d8-8217-6df35e48054b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.012163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1105/2223] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:38 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:39.017560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a959e0-6fd7-4033-967a-5b42373eb25d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.026469 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1119/2224] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:38 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:39.031503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91980222-6e60-41d8-8217-6df35e48054b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.033723 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a959e0-6fd7-4033-967a-5b42373eb25d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.051152 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91980222-6e60-41d8-8217-6df35e48054b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.054532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460674e-9b08-4e7b-9e61-25f88bf79b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.055724 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460674e-9b08-4e7b-9e61-25f88bf79b4d admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.056009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460674e-9b08-4e7b-9e61-25f88bf79b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.056288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460674e-9b08-4e7b-9e61-25f88bf79b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.057631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460674e-9b08-4e7b-9e61-25f88bf79b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.059886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460674e-9b08-4e7b-9e61-25f88bf79b4d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.071897 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01402ffa-7e07-480d-ba78-5639b2d92788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.072731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01402ffa-7e07-480d-ba78-5639b2d92788 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.073071 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01402ffa-7e07-480d-ba78-5639b2d92788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.073407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01402ffa-7e07-480d-ba78-5639b2d92788 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.074890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01402ffa-7e07-480d-ba78-5639b2d92788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.076700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01402ffa-7e07-480d-ba78-5639b2d92788 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.084260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1106/2225] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:39.088354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460674e-9b08-4e7b-9e61-25f88bf79b4d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.090706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1120/2226] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:39.097211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01402ffa-7e07-480d-ba78-5639b2d92788 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.102475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460674e-9b08-4e7b-9e61-25f88bf79b4d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.111326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d2e51-5871-4ff5-8f0c-82c5b8744a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.112032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2e51-5871-4ff5-8f0c-82c5b8744a71 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.112317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2e51-5871-4ff5-8f0c-82c5b8744a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.112593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2e51-5871-4ff5-8f0c-82c5b8744a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.113337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d2e51-5871-4ff5-8f0c-82c5b8744a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.115024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d2e51-5871-4ff5-8f0c-82c5b8744a71 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.118233 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01402ffa-7e07-480d-ba78-5639b2d92788 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.128682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07704a0-cb2c-4b5f-9ded-8a1ea19ad588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.129461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07704a0-cb2c-4b5f-9ded-8a1ea19ad588 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.129810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07704a0-cb2c-4b5f-9ded-8a1ea19ad588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.130173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07704a0-cb2c-4b5f-9ded-8a1ea19ad588 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.130931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07704a0-cb2c-4b5f-9ded-8a1ea19ad588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.132338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1107/2227] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:39.132819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07704a0-cb2c-4b5f-9ded-8a1ea19ad588 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.133250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d2e51-5871-4ff5-8f0c-82c5b8744a71 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.143955 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d2e51-5871-4ff5-8f0c-82c5b8744a71 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.148900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5bc65-cc61-4c95-bc65-b9959c82f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.149806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5bc65-cc61-4c95-bc65-b9959c82f7de admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.150190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5bc65-cc61-4c95-bc65-b9959c82f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.150398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5bc65-cc61-4c95-bc65-b9959c82f7de admin admin] PATH_INFO: `/v3/projects/40e8c89a7b5347e98a3df23cd1bfa364/users/efce08169211418bbe18ae16471ab110/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.152007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1121/2228] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:39.156416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07704a0-cb2c-4b5f-9ded-8a1ea19ad588 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.167409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07704a0-cb2c-4b5f-9ded-8a1ea19ad588 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.173249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5bc65-cc61-4c95-bc65-b9959c82f7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e8c89a7b5347e98a3df23cd1bfa364, user_id=efce08169211418bbe18ae16471ab110, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.175175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0e256-0e22-40db-8355-998959944055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.176183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0e256-0e22-40db-8355-998959944055 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.176527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0e256-0e22-40db-8355-998959944055 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.176863 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0e256-0e22-40db-8355-998959944055 admin admin] PATH_INFO: `/v3/projects/6cddc5af3a7047c3878266c4636c615b/users/6593498b952b446099817c54fdf804b7/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.178008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5bc65-cc61-4c95-bc65-b9959c82f7de admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.200901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1108/2229] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:39 2022] PUT /identity/v3/projects/40e8c89a7b5347e98a3df23cd1bfa364/users/efce08169211418bbe18ae16471ab110/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:39.205557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0e256-0e22-40db-8355-998959944055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cddc5af3a7047c3878266c4636c615b, user_id=6593498b952b446099817c54fdf804b7, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.209697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0e256-0e22-40db-8355-998959944055 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.211750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc10e7-7a6b-4b64-80c0-1b3a29e77dfe None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.212173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc10e7-7a6b-4b64-80c0-1b3a29e77dfe None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.212710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc10e7-7a6b-4b64-80c0-1b3a29e77dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.238871 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1122/2230] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:39 2022] PUT /identity/v3/projects/6cddc5af3a7047c3878266c4636c615b/users/6593498b952b446099817c54fdf804b7/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:39.253211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efd74a-d640-4e19-bd80-30000510af0a None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.253726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efd74a-d640-4e19-bd80-30000510af0a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.254362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efd74a-d640-4e19-bd80-30000510af0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.263962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-67bc10e7-7a6b-4b64-80c0-1b3a29e77dfe None None] MFA Rules not processed for user `efce08169211418bbe18ae16471ab110`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:39.269926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-67bc10e7-7a6b-4b64-80c0-1b3a29e77dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:39.299632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-74efd74a-d640-4e19-bd80-30000510af0a None None] MFA Rules not processed for user `6593498b952b446099817c54fdf804b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:39.302001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-74efd74a-d640-4e19-bd80-30000510af0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:39.365984 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1109/2231] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:39.374908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc10e7-7a6b-4b64-80c0-1b3a29e77dfe None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.376289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-67bc10e7-7a6b-4b64-80c0-1b3a29e77dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:39.388146 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1123/2232] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:39.394675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efd74a-d640-4e19-bd80-30000510af0a None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.493748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc10e7-7a6b-4b64-80c0-1b3a29e77dfe None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.504607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f3f38-4d2a-426d-8391-088f7e1bb569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.505489 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3f38-4d2a-426d-8391-088f7e1bb569 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.505775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3f38-4d2a-426d-8391-088f7e1bb569 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.506051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3f38-4d2a-426d-8391-088f7e1bb569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.515777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efd74a-d640-4e19-bd80-30000510af0a None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.521996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f3f38-4d2a-426d-8391-088f7e1bb569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.524563 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f3f38-4d2a-426d-8391-088f7e1bb569 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.533009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ee57d-db24-4ab2-a9bb-538a29bf944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.534910 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ee57d-db24-4ab2-a9bb-538a29bf944c admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.535314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ee57d-db24-4ab2-a9bb-538a29bf944c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.537050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ee57d-db24-4ab2-a9bb-538a29bf944c admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.540087 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ee57d-db24-4ab2-a9bb-538a29bf944c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.542895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1110/2233] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:39.555688 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ee57d-db24-4ab2-a9bb-538a29bf944c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.615440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1124/2234] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:39 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:39.619396 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f3f38-4d2a-426d-8391-088f7e1bb569 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.646960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f3f38-4d2a-426d-8391-088f7e1bb569 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.782985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938630a-1033-4487-a4fc-5f9a9a493285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.783752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938630a-1033-4487-a4fc-5f9a9a493285 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.784194 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938630a-1033-4487-a4fc-5f9a9a493285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.784367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938630a-1033-4487-a4fc-5f9a9a493285 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.785231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938630a-1033-4487-a4fc-5f9a9a493285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.787598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938630a-1033-4487-a4fc-5f9a9a493285 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.813942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1111/2235] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:39 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:39.822354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ee57d-db24-4ab2-a9bb-538a29bf944c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.840860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ee57d-db24-4ab2-a9bb-538a29bf944c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.848874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993ee84-7e42-4e6a-8159-8bd254aed4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.849572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993ee84-7e42-4e6a-8159-8bd254aed4be admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.850386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993ee84-7e42-4e6a-8159-8bd254aed4be admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.850666 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993ee84-7e42-4e6a-8159-8bd254aed4be admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.851872 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993ee84-7e42-4e6a-8159-8bd254aed4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.865626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993ee84-7e42-4e6a-8159-8bd254aed4be admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.891136 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1125/2236] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:39.905985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938630a-1033-4487-a4fc-5f9a9a493285 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:39.934111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938630a-1033-4487-a4fc-5f9a9a493285 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:39.941103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e01d5-706f-4e91-a14e-f4b248a05db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:39.942293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e01d5-706f-4e91-a14e-f4b248a05db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:39.942771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e01d5-706f-4e91-a14e-f4b248a05db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:39.943366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e01d5-706f-4e91-a14e-f4b248a05db3 admin admin] PATH_INFO: `/v3/projects/573b3495eb82424dbed2fe2388e8e9c4/users/92951d78f6f14fd083cd564214afee63/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:39.962289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e01d5-706f-4e91-a14e-f4b248a05db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573b3495eb82424dbed2fe2388e8e9c4, user_id=92951d78f6f14fd083cd564214afee63, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:39.965283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e01d5-706f-4e91-a14e-f4b248a05db3 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:39.991924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1112/2237] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:39 2022] PUT /identity/v3/projects/573b3495eb82424dbed2fe2388e8e9c4/users/92951d78f6f14fd083cd564214afee63/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:39.997883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993ee84-7e42-4e6a-8159-8bd254aed4be admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:40.012103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993ee84-7e42-4e6a-8159-8bd254aed4be admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:40.144558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f504dea-f9f0-4492-b41e-9d9d672114bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:40.145330 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f504dea-f9f0-4492-b41e-9d9d672114bc admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:40.146478 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f504dea-f9f0-4492-b41e-9d9d672114bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:40.146757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f504dea-f9f0-4492-b41e-9d9d672114bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:40.149747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f504dea-f9f0-4492-b41e-9d9d672114bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:40.151547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f504dea-f9f0-4492-b41e-9d9d672114bc admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:40.164162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1126/2238] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:40.169014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e01d5-706f-4e91-a14e-f4b248a05db3 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:40.188117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e01d5-706f-4e91-a14e-f4b248a05db3 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:40.201869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca01b2-4b6c-4033-8e47-80870526b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:40.202931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca01b2-4b6c-4033-8e47-80870526b2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:40.203211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca01b2-4b6c-4033-8e47-80870526b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:40.203679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca01b2-4b6c-4033-8e47-80870526b2dd admin admin] PATH_INFO: `/v3/projects/573b3495eb82424dbed2fe2388e8e9c4/users/92951d78f6f14fd083cd564214afee63/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:40.205832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca01b2-4b6c-4033-8e47-80870526b2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=573b3495eb82424dbed2fe2388e8e9c4, user_id=92951d78f6f14fd083cd564214afee63, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:40.208737 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca01b2-4b6c-4033-8e47-80870526b2dd admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:40.246361 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1113/2239] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:40 2022] PUT /identity/v3/projects/573b3495eb82424dbed2fe2388e8e9c4/users/92951d78f6f14fd083cd564214afee63/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:40.252921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf3981-5b07-453e-bde9-7f300e51cab2 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:40.253210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf3981-5b07-453e-bde9-7f300e51cab2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:40.253494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf3981-5b07-453e-bde9-7f300e51cab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:40.305279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-53cf3981-5b07-453e-bde9-7f300e51cab2 None None] MFA Rules not processed for user `92951d78f6f14fd083cd564214afee63`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:40.306787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-53cf3981-5b07-453e-bde9-7f300e51cab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:40.459736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1127/2240] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:40.473518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca01b2-4b6c-4033-8e47-80870526b2dd admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:40.475727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8eca01b2-4b6c-4033-8e47-80870526b2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:40.549770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca01b2-4b6c-4033-8e47-80870526b2dd admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:40.553738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f339902-b970-4147-a0da-50dd83888bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:40.554616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f339902-b970-4147-a0da-50dd83888bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:40.555041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f339902-b970-4147-a0da-50dd83888bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:40.555410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f339902-b970-4147-a0da-50dd83888bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:40.578961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f339902-b970-4147-a0da-50dd83888bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:40.578961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f339902-b970-4147-a0da-50dd83888bb6 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:40.583524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1114/2241] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:40.662556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf3981-5b07-453e-bde9-7f300e51cab2 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:40.727046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf3981-5b07-453e-bde9-7f300e51cab2 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:40.732337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:40.733372 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:40.733746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:40.734031 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] PATH_INFO: `/v3/users/6593498b952b446099817c54fdf804b7` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:40.735358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6593498b952b446099817c54fdf804b7)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:40.737322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:40.797815 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6593498b952b446099817c54fdf804b7'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:40.827425 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6593498b952b446099817c54fdf804b7'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:40.828244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6593498b952b446099817c54fdf804b7'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:40.829044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6593498b952b446099817c54fdf804b7'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:40.837472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6593498b952b446099817c54fdf804b7'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:40.853508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1128/2242] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:40 2022] DELETE /identity/v3/users/6593498b952b446099817c54fdf804b7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:40.858043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23492689-6389-4696-b2d9-2b1aa707696b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:40.858368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23492689-6389-4696-b2d9-2b1aa707696b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:40.858737 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23492689-6389-4696-b2d9-2b1aa707696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:40.876883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-23492689-6389-4696-b2d9-2b1aa707696b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:40.878295 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-23492689-6389-4696-b2d9-2b1aa707696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:40.959104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1115/2243] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:40.971060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:40.973740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:41.071651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69e57d-b738-4ac2-ba47-5b63fab95343 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:41.075657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65646b4-9e48-4f75-894a-bbbc413a7920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:41.076325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65646b4-9e48-4f75-894a-bbbc413a7920 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:41.077067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65646b4-9e48-4f75-894a-bbbc413a7920 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:41.077067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65646b4-9e48-4f75-894a-bbbc413a7920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:41.087713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65646b4-9e48-4f75-894a-bbbc413a7920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:41.088764 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65646b4-9e48-4f75-894a-bbbc413a7920 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:41.108255 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1129/2244] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:41.491958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23492689-6389-4696-b2d9-2b1aa707696b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:41.493426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-23492689-6389-4696-b2d9-2b1aa707696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:41.510123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23492689-6389-4696-b2d9-2b1aa707696b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:41.517105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:41.518326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:41.518750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:41.519162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] PATH_INFO: `/v3/projects/6cddc5af3a7047c3878266c4636c615b` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:41.520602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cddc5af3a7047c3878266c4636c615b)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:41.522831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:41.607187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cddc5af3a7047c3878266c4636c615b', 'request_id': 'req-60703745-37fc-4bc6-a7af-d6ef5b04d994'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:41.619383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cddc5af3a7047c3878266c4636c615b', 'request_id': 'req-60703745-37fc-4bc6-a7af-d6ef5b04d994'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:41.630825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cddc5af3a7047c3878266c4636c615b', 'request_id': 'req-60703745-37fc-4bc6-a7af-d6ef5b04d994'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:41.643895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] The token cache is being invalidate because project 6cddc5af3a7047c3878266c4636c615b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:41.644192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:41.650171 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60703745-37fc-4bc6-a7af-d6ef5b04d994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:41.651927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1116/2245] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:41 2022] DELETE /identity/v3/projects/6cddc5af3a7047c3878266c4636c615b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:41.656215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65646b4-9e48-4f75-894a-bbbc413a7920 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:41.666882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65646b4-9e48-4f75-894a-bbbc413a7920 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:41.734102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:41.735503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:41.735964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:41.736747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] PATH_INFO: `/v3/users/92951d78f6f14fd083cd564214afee63` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:41.738392 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92951d78f6f14fd083cd564214afee63)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:41.740692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:41.841515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92951d78f6f14fd083cd564214afee63'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:41.856212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92951d78f6f14fd083cd564214afee63'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:41.856944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92951d78f6f14fd083cd564214afee63'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:41.857551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92951d78f6f14fd083cd564214afee63'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:41.870888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92951d78f6f14fd083cd564214afee63'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:41.886787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1130/2246] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:41 2022] DELETE /identity/v3/users/92951d78f6f14fd083cd564214afee63 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:42.209361 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68854ca-9cdb-4808-b06f-5b011dfb7b5d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.209643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68854ca-9cdb-4808-b06f-5b011dfb7b5d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.209920 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68854ca-9cdb-4808-b06f-5b011dfb7b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.239726 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-a68854ca-9cdb-4808-b06f-5b011dfb7b5d None None] MFA Rules not processed for user `743564ffbc354c85814a07001a3c387e`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:42.241169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a68854ca-9cdb-4808-b06f-5b011dfb7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:42.326310 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1117/2247] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:42.333912 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:42.334415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68854ca-9cdb-4808-b06f-5b011dfb7b5d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:42.335901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a68854ca-9cdb-4808-b06f-5b011dfb7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:42.336588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:42.426854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fae1f-153a-4b85-a481-f08382050575 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:42.432280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144bdc4-c76d-4ef9-a3eb-ded642e6fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:42.433169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144bdc4-c76d-4ef9-a3eb-ded642e6fae0 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.433567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144bdc4-c76d-4ef9-a3eb-ded642e6fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.433936 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144bdc4-c76d-4ef9-a3eb-ded642e6fae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.434851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144bdc4-c76d-4ef9-a3eb-ded642e6fae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:42.437033 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144bdc4-c76d-4ef9-a3eb-ded642e6fae0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:42.470479 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1131/2248] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:42 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:42.472060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144bdc4-c76d-4ef9-a3eb-ded642e6fae0 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:42.539471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144bdc4-c76d-4ef9-a3eb-ded642e6fae0 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:42.541254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68854ca-9cdb-4808-b06f-5b011dfb7b5d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:42.545234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0eb97-309f-46e1-a761-3c9065213f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:42.545926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0eb97-309f-46e1-a761-3c9065213f78 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.546139 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:42.546278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0eb97-309f-46e1-a761-3c9065213f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.546571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0eb97-309f-46e1-a761-3c9065213f78 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.547277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0eb97-309f-46e1-a761-3c9065213f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:42.547368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.547704 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.548073 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] PATH_INFO: `/v3/projects/573b3495eb82424dbed2fe2388e8e9c4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.549242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0eb97-309f-46e1-a761-3c9065213f78 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:42.549359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=573b3495eb82424dbed2fe2388e8e9c4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:42.551389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:42.577519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1132/2249] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:42 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:42.578597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0eb97-309f-46e1-a761-3c9065213f78 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:42.588742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0eb97-309f-46e1-a761-3c9065213f78 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:42.594042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a49d8b-234f-43a9-b284-0740ceffe49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:42.594809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49d8b-234f-43a9-b284-0740ceffe49a admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.595162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49d8b-234f-43a9-b284-0740ceffe49a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.595502 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49d8b-234f-43a9-b284-0740ceffe49a admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.596322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a49d8b-234f-43a9-b284-0740ceffe49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:42.598029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a49d8b-234f-43a9-b284-0740ceffe49a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:42.610128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1133/2250] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:42.611736 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573b3495eb82424dbed2fe2388e8e9c4', 'request_id': 'req-f7aa0202-b139-4d37-a1db-f0cdb2735b74'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:42.614370 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a49d8b-234f-43a9-b284-0740ceffe49a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:42.618353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573b3495eb82424dbed2fe2388e8e9c4', 'request_id': 'req-f7aa0202-b139-4d37-a1db-f0cdb2735b74'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:42.624463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a49d8b-234f-43a9-b284-0740ceffe49a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:42.626364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573b3495eb82424dbed2fe2388e8e9c4', 'request_id': 'req-f7aa0202-b139-4d37-a1db-f0cdb2735b74'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:42.636332 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] The token cache is being invalidate because project 573b3495eb82424dbed2fe2388e8e9c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:42.636609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:42.637241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7aa0202-b139-4d37-a1db-f0cdb2735b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:42.638799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1118/2251] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:42 2022] DELETE /identity/v3/projects/573b3495eb82424dbed2fe2388e8e9c4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:42.644144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665b130-740a-4cf0-8b90-3c5a7ebc5b14 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.644427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665b130-740a-4cf0-8b90-3c5a7ebc5b14 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.644713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665b130-740a-4cf0-8b90-3c5a7ebc5b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.670610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-8665b130-740a-4cf0-8b90-3c5a7ebc5b14 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:42.671902 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8665b130-740a-4cf0-8b90-3c5a7ebc5b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:42.686239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca56b6c-3364-425b-bda4-cca0faff1229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:42.687258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca56b6c-3364-425b-bda4-cca0faff1229 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.687606 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca56b6c-3364-425b-bda4-cca0faff1229 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.688002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca56b6c-3364-425b-bda4-cca0faff1229 admin admin] PATH_INFO: `/v3/projects/227dc1f40cb645149e3c99698b5229a2/users/236e31647c024eb2a09d1607a32a7ec4/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.711564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca56b6c-3364-425b-bda4-cca0faff1229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227dc1f40cb645149e3c99698b5229a2, user_id=236e31647c024eb2a09d1607a32a7ec4, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:42.714386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca56b6c-3364-425b-bda4-cca0faff1229 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:42.728779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1134/2252] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:42 2022] PUT /identity/v3/projects/227dc1f40cb645149e3c99698b5229a2/users/236e31647c024eb2a09d1607a32a7ec4/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:42.732753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca56b6c-3364-425b-bda4-cca0faff1229 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:42.734393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2ca56b6c-3364-425b-bda4-cca0faff1229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:42.734538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1119/2253] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:42.742188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30788dc4-60d7-469e-aaf9-e507a26ea32b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.742481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30788dc4-60d7-469e-aaf9-e507a26ea32b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.742757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30788dc4-60d7-469e-aaf9-e507a26ea32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.760806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-30788dc4-60d7-469e-aaf9-e507a26ea32b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:42.762264 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-30788dc4-60d7-469e-aaf9-e507a26ea32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:42.798991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca56b6c-3364-425b-bda4-cca0faff1229 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:42.803784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23682edf-ec47-40c2-9691-880110f3eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:42.804473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23682edf-ec47-40c2-9691-880110f3eb08 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.804756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23682edf-ec47-40c2-9691-880110f3eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.805064 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23682edf-ec47-40c2-9691-880110f3eb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.805802 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23682edf-ec47-40c2-9691-880110f3eb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:42.807472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23682edf-ec47-40c2-9691-880110f3eb08 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:42.819040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1135/2254] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:42.823615 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23682edf-ec47-40c2-9691-880110f3eb08 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:42.830180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1120/2255] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:42.833855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23682edf-ec47-40c2-9691-880110f3eb08 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:42.834257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30788dc4-60d7-469e-aaf9-e507a26ea32b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:42.838613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495f705-af27-47a4-b659-896b6af9343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:42.839512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495f705-af27-47a4-b659-896b6af9343a admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.839792 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495f705-af27-47a4-b659-896b6af9343a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.840110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495f705-af27-47a4-b659-896b6af9343a admin admin] PATH_INFO: `/v3/projects/227dc1f40cb645149e3c99698b5229a2/users/236e31647c024eb2a09d1607a32a7ec4/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.842125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495f705-af27-47a4-b659-896b6af9343a admin admin] RBAC: Authorizing `identity:create_grant(project_id=227dc1f40cb645149e3c99698b5229a2, user_id=236e31647c024eb2a09d1607a32a7ec4, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:42.843530 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30788dc4-60d7-469e-aaf9-e507a26ea32b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:42.844879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495f705-af27-47a4-b659-896b6af9343a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:42.850485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c11518-2561-4aec-ac77-551a3d831c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:42.851143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c11518-2561-4aec-ac77-551a3d831c13 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.851494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c11518-2561-4aec-ac77-551a3d831c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.851830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c11518-2561-4aec-ac77-551a3d831c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.852628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c11518-2561-4aec-ac77-551a3d831c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:42.852997 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c11518-2561-4aec-ac77-551a3d831c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:42.854639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c11518-2561-4aec-ac77-551a3d831c13 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:42.857927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1136/2256] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:42 2022] PUT /identity/v3/projects/227dc1f40cb645149e3c99698b5229a2/users/236e31647c024eb2a09d1607a32a7ec4/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:42.867108 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1121/2257] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:53:42.872195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495f705-af27-47a4-b659-896b6af9343a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:42.939635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495f705-af27-47a4-b659-896b6af9343a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:42.945082 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44787a-1af9-4b0c-b013-f75c359246ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:42.945911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44787a-1af9-4b0c-b013-f75c359246ca admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:42.946295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44787a-1af9-4b0c-b013-f75c359246ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:42.946638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44787a-1af9-4b0c-b013-f75c359246ca admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:42.947515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44787a-1af9-4b0c-b013-f75c359246ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:42.949697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44787a-1af9-4b0c-b013-f75c359246ca admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:42.978686 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1137/2258] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:42 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:42.983155 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c11518-2561-4aec-ac77-551a3d831c13 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:42.993487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c11518-2561-4aec-ac77-551a3d831c13 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.069598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01239ba-bf6f-48d9-be9a-8f2f2befd5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.070505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01239ba-bf6f-48d9-be9a-8f2f2befd5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.070845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01239ba-bf6f-48d9-be9a-8f2f2befd5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.071195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01239ba-bf6f-48d9-be9a-8f2f2befd5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.071961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01239ba-bf6f-48d9-be9a-8f2f2befd5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:43.074319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01239ba-bf6f-48d9-be9a-8f2f2befd5a4 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:43.094637 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1122/2259] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:42 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:43.098935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44787a-1af9-4b0c-b013-f75c359246ca admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:43.115598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44787a-1af9-4b0c-b013-f75c359246ca admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.131575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec0097-892c-45c5-866e-e856aa318797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.132583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec0097-892c-45c5-866e-e856aa318797 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.132861 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec0097-892c-45c5-866e-e856aa318797 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.133129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec0097-892c-45c5-866e-e856aa318797 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.133957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec0097-892c-45c5-866e-e856aa318797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:43.135919 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec0097-892c-45c5-866e-e856aa318797 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:43.155164 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1138/2260] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:43.163609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01239ba-bf6f-48d9-be9a-8f2f2befd5a4 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:43.175791 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01239ba-bf6f-48d9-be9a-8f2f2befd5a4 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.190825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68718373-ad5b-4ac3-8214-8adb394c1b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.191749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68718373-ad5b-4ac3-8214-8adb394c1b2a admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.192170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68718373-ad5b-4ac3-8214-8adb394c1b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.192601 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68718373-ad5b-4ac3-8214-8adb394c1b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.193340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68718373-ad5b-4ac3-8214-8adb394c1b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:43.195018 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68718373-ad5b-4ac3-8214-8adb394c1b2a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:43.206804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1123/2261] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:43.218051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec0097-892c-45c5-866e-e856aa318797 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:43.249454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec0097-892c-45c5-866e-e856aa318797 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.267041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e1e84-5e30-4be8-8422-a2c1be60a7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.267883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e1e84-5e30-4be8-8422-a2c1be60a7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.268165 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e1e84-5e30-4be8-8422-a2c1be60a7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.268443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e1e84-5e30-4be8-8422-a2c1be60a7f1 admin admin] PATH_INFO: `/v3/projects/03e7cddbb67443e3a51002e45822b559/users/54c81f1c877e463c829f7ca4c832a8fc/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.297531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e1e84-5e30-4be8-8422-a2c1be60a7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e7cddbb67443e3a51002e45822b559, user_id=54c81f1c877e463c829f7ca4c832a8fc, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:43.300407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e1e84-5e30-4be8-8422-a2c1be60a7f1 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:43.322376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1139/2262] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:43 2022] PUT /identity/v3/projects/03e7cddbb67443e3a51002e45822b559/users/54c81f1c877e463c829f7ca4c832a8fc/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:43.334005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aef1f-d32e-4687-a177-c5125b690e57 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.334631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aef1f-d32e-4687-a177-c5125b690e57 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.334915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aef1f-d32e-4687-a177-c5125b690e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.384097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-a64aef1f-d32e-4687-a177-c5125b690e57 None None] MFA Rules not processed for user `54c81f1c877e463c829f7ca4c832a8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:43.385849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a64aef1f-d32e-4687-a177-c5125b690e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:43.474723 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1124/2263] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:43.479136 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e1e84-5e30-4be8-8422-a2c1be60a7f1 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:43.582788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e1e84-5e30-4be8-8422-a2c1be60a7f1 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.594212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787557-4ec7-437f-a1c8-ce0a6c548da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.596492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787557-4ec7-437f-a1c8-ce0a6c548da0 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.596965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787557-4ec7-437f-a1c8-ce0a6c548da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.597680 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787557-4ec7-437f-a1c8-ce0a6c548da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.598917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95787557-4ec7-437f-a1c8-ce0a6c548da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:43.601161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95787557-4ec7-437f-a1c8-ce0a6c548da0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:43.636413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1140/2264] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:43 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:43.640577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aef1f-d32e-4687-a177-c5125b690e57 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:43.663859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aef1f-d32e-4687-a177-c5125b690e57 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.765943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e771-fd69-41d1-809f-210bddb8776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.767090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e771-fd69-41d1-809f-210bddb8776a admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.767551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e771-fd69-41d1-809f-210bddb8776a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.768122 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e771-fd69-41d1-809f-210bddb8776a admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.769520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e771-fd69-41d1-809f-210bddb8776a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:43.774393 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e771-fd69-41d1-809f-210bddb8776a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:43.839191 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1125/2265] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:43 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:43.840070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787557-4ec7-437f-a1c8-ce0a6c548da0 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:43.858320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787557-4ec7-437f-a1c8-ce0a6c548da0 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.867338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5017365-f78e-4247-a61c-f10c24f27a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.868207 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5017365-f78e-4247-a61c-f10c24f27a13 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.868578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5017365-f78e-4247-a61c-f10c24f27a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.868988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5017365-f78e-4247-a61c-f10c24f27a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.870012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5017365-f78e-4247-a61c-f10c24f27a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:43.873701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5017365-f78e-4247-a61c-f10c24f27a13 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:43.888717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1141/2266] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:43.893095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e771-fd69-41d1-809f-210bddb8776a admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:43.925062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e771-fd69-41d1-809f-210bddb8776a admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.937411 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994b30d-0f22-4b6d-a145-452883c05e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.939291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b30d-0f22-4b6d-a145-452883c05e27 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.939573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b30d-0f22-4b6d-a145-452883c05e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.939850 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b30d-0f22-4b6d-a145-452883c05e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.941713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994b30d-0f22-4b6d-a145-452883c05e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:43.944089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994b30d-0f22-4b6d-a145-452883c05e27 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:43.976169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5017365-f78e-4247-a61c-f10c24f27a13 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:43.986472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1126/2267] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:43.988623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5017365-f78e-4247-a61c-f10c24f27a13 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.995685 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7e4e2-8edf-4362-acfe-7be3c3139473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.996618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7e4e2-8edf-4362-acfe-7be3c3139473 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.997087 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7e4e2-8edf-4362-acfe-7be3c3139473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.997927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7e4e2-8edf-4362-acfe-7be3c3139473 admin admin] PATH_INFO: `/v3/projects/f083e3ee85ea40ba8c27e88381640e00/users/c8f09ba9779c4346826d92d694e718c4/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.016476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7e4e2-8edf-4362-acfe-7be3c3139473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f083e3ee85ea40ba8c27e88381640e00, user_id=c8f09ba9779c4346826d92d694e718c4, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.021136 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7e4e2-8edf-4362-acfe-7be3c3139473 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.052234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1142/2268] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:43 2022] PUT /identity/v3/projects/f083e3ee85ea40ba8c27e88381640e00/users/c8f09ba9779c4346826d92d694e718c4/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:44.063783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff65bb-c840-4ab6-a0ee-9f9ac237e5cb None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.064128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff65bb-c840-4ab6-a0ee-9f9ac237e5cb None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.064410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff65bb-c840-4ab6-a0ee-9f9ac237e5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.102444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-a4ff65bb-c840-4ab6-a0ee-9f9ac237e5cb None None] MFA Rules not processed for user `c8f09ba9779c4346826d92d694e718c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:44.104095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a4ff65bb-c840-4ab6-a0ee-9f9ac237e5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:44.198786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1127/2269] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:44.203046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7e4e2-8edf-4362-acfe-7be3c3139473 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:44.311918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7e4e2-8edf-4362-acfe-7be3c3139473 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:44.325217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c7871-74c3-48f8-9026-1036275aa89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:44.327025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7871-74c3-48f8-9026-1036275aa89f admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.327969 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7871-74c3-48f8-9026-1036275aa89f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.328411 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7871-74c3-48f8-9026-1036275aa89f admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.329132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c7871-74c3-48f8-9026-1036275aa89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.332166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c7871-74c3-48f8-9026-1036275aa89f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.393451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1143/2270] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:44 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:44.393809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff65bb-c840-4ab6-a0ee-9f9ac237e5cb None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:44.409840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff65bb-c840-4ab6-a0ee-9f9ac237e5cb None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:44.496384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e94e3-8a9b-486f-b477-0d3ef9f90c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:44.497389 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e94e3-8a9b-486f-b477-0d3ef9f90c92 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.497875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e94e3-8a9b-486f-b477-0d3ef9f90c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.498337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e94e3-8a9b-486f-b477-0d3ef9f90c92 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.499317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e94e3-8a9b-486f-b477-0d3ef9f90c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.501989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e94e3-8a9b-486f-b477-0d3ef9f90c92 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.537032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1128/2271] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:44 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:44.541809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c7871-74c3-48f8-9026-1036275aa89f admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:44.553738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c7871-74c3-48f8-9026-1036275aa89f admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:44.585524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838d924-c817-4211-82f7-a7a83749899f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:44.586354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838d924-c817-4211-82f7-a7a83749899f admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.586577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838d924-c817-4211-82f7-a7a83749899f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.586920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838d924-c817-4211-82f7-a7a83749899f admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.587842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838d924-c817-4211-82f7-a7a83749899f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.589862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838d924-c817-4211-82f7-a7a83749899f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.632237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e94e3-8a9b-486f-b477-0d3ef9f90c92 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:44.634844 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1144/2272] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:44.651946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e94e3-8a9b-486f-b477-0d3ef9f90c92 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:44.664347 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16627eae-82c5-4030-850f-bab514821437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:44.666745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16627eae-82c5-4030-850f-bab514821437 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.667077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16627eae-82c5-4030-850f-bab514821437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.668027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16627eae-82c5-4030-850f-bab514821437 admin admin] PATH_INFO: `/v3/projects/d5ecdeee2671486fab04d86adfe00dbe/users/77977d7b0ecc48d49717a8cf062b2365/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.692581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16627eae-82c5-4030-850f-bab514821437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ecdeee2671486fab04d86adfe00dbe, user_id=77977d7b0ecc48d49717a8cf062b2365, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.695686 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16627eae-82c5-4030-850f-bab514821437 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.719025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1129/2273] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:44 2022] PUT /identity/v3/projects/d5ecdeee2671486fab04d86adfe00dbe/users/77977d7b0ecc48d49717a8cf062b2365/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:44.722929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838d924-c817-4211-82f7-a7a83749899f admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:44.741912 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838d924-c817-4211-82f7-a7a83749899f admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:44.860073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47f956-f1e4-4f48-b49a-c48e38953b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:44.860757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47f956-f1e4-4f48-b49a-c48e38953b81 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.861052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47f956-f1e4-4f48-b49a-c48e38953b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.861493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47f956-f1e4-4f48-b49a-c48e38953b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.862486 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47f956-f1e4-4f48-b49a-c48e38953b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.864672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47f956-f1e4-4f48-b49a-c48e38953b81 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.878007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1145/2274] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:44.890430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16627eae-82c5-4030-850f-bab514821437 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:44.902329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16627eae-82c5-4030-850f-bab514821437 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:44.918441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb475-cf9d-4c25-b592-1e1a46731f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:44.919454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb475-cf9d-4c25-b592-1e1a46731f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.920136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb475-cf9d-4c25-b592-1e1a46731f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.921780 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb475-cf9d-4c25-b592-1e1a46731f83 admin admin] PATH_INFO: `/v3/projects/d5ecdeee2671486fab04d86adfe00dbe/users/77977d7b0ecc48d49717a8cf062b2365/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.934005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eb475-cf9d-4c25-b592-1e1a46731f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ecdeee2671486fab04d86adfe00dbe, user_id=77977d7b0ecc48d49717a8cf062b2365, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.937254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eb475-cf9d-4c25-b592-1e1a46731f83 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.982174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1130/2275] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:44 2022] PUT /identity/v3/projects/d5ecdeee2671486fab04d86adfe00dbe/users/77977d7b0ecc48d49717a8cf062b2365/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:44.991549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5348c3-6193-47e7-b61f-7c298f50bc05 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.994385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5348c3-6193-47e7-b61f-7c298f50bc05 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.994385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5348c3-6193-47e7-b61f-7c298f50bc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:45.029760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-8e5348c3-6193-47e7-b61f-7c298f50bc05 None None] MFA Rules not processed for user `77977d7b0ecc48d49717a8cf062b2365`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:45.031423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8e5348c3-6193-47e7-b61f-7c298f50bc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:45.168338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1146/2276] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:45.223942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb475-cf9d-4c25-b592-1e1a46731f83 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:45.227010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d96eb475-cf9d-4c25-b592-1e1a46731f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:45.305192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb475-cf9d-4c25-b592-1e1a46731f83 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:45.312476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38551e-a92a-4418-b32d-6cf55e82512a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:45.313337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38551e-a92a-4418-b32d-6cf55e82512a service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:45.313909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38551e-a92a-4418-b32d-6cf55e82512a service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:45.314375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38551e-a92a-4418-b32d-6cf55e82512a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:45.325831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38551e-a92a-4418-b32d-6cf55e82512a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:45.327602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38551e-a92a-4418-b32d-6cf55e82512a service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:45.345946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1131/2277] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:45.451761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5348c3-6193-47e7-b61f-7c298f50bc05 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:45.465403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5348c3-6193-47e7-b61f-7c298f50bc05 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:45.471931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad36b8-8c64-4ec6-9787-91e6fadbb941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:45.472785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad36b8-8c64-4ec6-9787-91e6fadbb941 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:45.473093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad36b8-8c64-4ec6-9787-91e6fadbb941 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:45.473742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad36b8-8c64-4ec6-9787-91e6fadbb941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:45.583223 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad36b8-8c64-4ec6-9787-91e6fadbb941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:45.584885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad36b8-8c64-4ec6-9787-91e6fadbb941 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:45.613325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1147/2278] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:46.345746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38551e-a92a-4418-b32d-6cf55e82512a service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:46.348357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9e38551e-a92a-4418-b32d-6cf55e82512a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:46.495616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38551e-a92a-4418-b32d-6cf55e82512a service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:46.502114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:46.503597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:46.504114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:46.504559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] PATH_INFO: `/v3/users/7cec4bd7337b4cf19a8a2794f5cea78e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:46.511972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cec4bd7337b4cf19a8a2794f5cea78e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:46.523300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:46.615116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cec4bd7337b4cf19a8a2794f5cea78e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:46.641598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cec4bd7337b4cf19a8a2794f5cea78e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:46.642407 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cec4bd7337b4cf19a8a2794f5cea78e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:46.666210 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cec4bd7337b4cf19a8a2794f5cea78e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:46.667544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cec4bd7337b4cf19a8a2794f5cea78e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:46.693328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1132/2279] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:46 2022] DELETE /identity/v3/users/7cec4bd7337b4cf19a8a2794f5cea78e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:46.694777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a73ffd-4b8e-4ea6-95a1-b4fb2da20269 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:46.695265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a73ffd-4b8e-4ea6-95a1-b4fb2da20269 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:46.695371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a73ffd-4b8e-4ea6-95a1-b4fb2da20269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:46.730641 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:46.731371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-18a73ffd-4b8e-4ea6-95a1-b4fb2da20269 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:46.732396 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:46.732937 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-18a73ffd-4b8e-4ea6-95a1-b4fb2da20269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:46.833917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1148/2280] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:46.845321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a73ffd-4b8e-4ea6-95a1-b4fb2da20269 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:46.850303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-18a73ffd-4b8e-4ea6-95a1-b4fb2da20269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:46.878463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc8ac3-5861-4a81-a515-2937eec3aa53 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:46.884333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:46.885438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:46.885804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:46.886219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] PATH_INFO: `/v3/users/efce08169211418bbe18ae16471ab110` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:46.887562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efce08169211418bbe18ae16471ab110)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:46.889594 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:46.969012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a73ffd-4b8e-4ea6-95a1-b4fb2da20269 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:46.973233 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1c8fd-5477-4704-8dfc-421fe597e976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:46.973931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1c8fd-5477-4704-8dfc-421fe597e976 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:46.974395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1c8fd-5477-4704-8dfc-421fe597e976 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:46.974770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1c8fd-5477-4704-8dfc-421fe597e976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:47.000942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1c8fd-5477-4704-8dfc-421fe597e976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:47.002423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1c8fd-5477-4704-8dfc-421fe597e976 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:47.005822 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efce08169211418bbe18ae16471ab110'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:47.022176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1149/2281] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:47.041591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efce08169211418bbe18ae16471ab110'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:47.042539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efce08169211418bbe18ae16471ab110'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:47.063775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efce08169211418bbe18ae16471ab110'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:47.064461 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efce08169211418bbe18ae16471ab110'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:47.089240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1133/2282] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:46 2022] DELETE /identity/v3/users/efce08169211418bbe18ae16471ab110 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:47.093876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1c503-0de6-46a8-b01c-c2f7b034d7bb None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:47.094188 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1c503-0de6-46a8-b01c-c2f7b034d7bb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:47.094467 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1c503-0de6-46a8-b01c-c2f7b034d7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:47.138125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-99a1c503-0de6-46a8-b01c-c2f7b034d7bb None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:47.145704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-99a1c503-0de6-46a8-b01c-c2f7b034d7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:47.378682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1150/2283] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:47.506803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:47.508963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:47.703624 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da1e1d-e293-462e-b9c9-89c7b4e7a540 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:47.716730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c28a9-2a29-4131-b853-de6311ac8a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:47.717408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c28a9-2a29-4131-b853-de6311ac8a1f service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:47.717693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c28a9-2a29-4131-b853-de6311ac8a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:47.718039 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c28a9-2a29-4131-b853-de6311ac8a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:47.749362 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c28a9-2a29-4131-b853-de6311ac8a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:47.752843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c28a9-2a29-4131-b853-de6311ac8a1f service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:47.781438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1134/2284] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:48.433151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1c503-0de6-46a8-b01c-c2f7b034d7bb None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:48.434702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-99a1c503-0de6-46a8-b01c-c2f7b034d7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:48.456602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1c503-0de6-46a8-b01c-c2f7b034d7bb None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:48.482876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:48.485609 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:48.486371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:48.486858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] PATH_INFO: `/v3/projects/0ea9d3b0a3cc4e8e8769904e5fb31ac2` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:48.488896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea9d3b0a3cc4e8e8769904e5fb31ac2)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:48.491537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:48.648452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea9d3b0a3cc4e8e8769904e5fb31ac2', 'request_id': 'req-b44378e5-c198-45be-b318-1f6eda3872b0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:48.666693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea9d3b0a3cc4e8e8769904e5fb31ac2', 'request_id': 'req-b44378e5-c198-45be-b318-1f6eda3872b0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:48.683756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea9d3b0a3cc4e8e8769904e5fb31ac2', 'request_id': 'req-b44378e5-c198-45be-b318-1f6eda3872b0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:48.707902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] The token cache is being invalidate because project 0ea9d3b0a3cc4e8e8769904e5fb31ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:48.708200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:48.709923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-b44378e5-c198-45be-b318-1f6eda3872b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:48.711992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1151/2285] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:48 2022] DELETE /identity/v3/projects/0ea9d3b0a3cc4e8e8769904e5fb31ac2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:48.716119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c28a9-2a29-4131-b853-de6311ac8a1f service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:48.731234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c28a9-2a29-4131-b853-de6311ac8a1f service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:48.830432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:48.831365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:48.831925 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:48.832329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] PATH_INFO: `/v3/users/924a836e6464430890090993702a9a3c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:48.834472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924a836e6464430890090993702a9a3c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:48.836667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:48.976480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924a836e6464430890090993702a9a3c'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:49.030460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924a836e6464430890090993702a9a3c'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:49.034109 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924a836e6464430890090993702a9a3c'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:49.052921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916bb32-c2b2-4708-8c44-d83d98586948 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:49.053694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916bb32-c2b2-4708-8c44-d83d98586948 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:49.054045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916bb32-c2b2-4708-8c44-d83d98586948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:49.078450 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924a836e6464430890090993702a9a3c'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:49.079163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924a836e6464430890090993702a9a3c'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:49.107768 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1135/2286] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:48 2022] DELETE /identity/v3/users/924a836e6464430890090993702a9a3c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:49.120272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-c916bb32-c2b2-4708-8c44-d83d98586948 None None] MFA Rules not processed for user `236e31647c024eb2a09d1607a32a7ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:49.122039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c916bb32-c2b2-4708-8c44-d83d98586948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:49.371354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1152/2287] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:49.592881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:49.594667 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:49.780644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26cd71-9cb2-404f-a348-901e45c8b730 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:49.808909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc497cf8-109d-47e0-93a9-c02a1a24a1c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:49.816263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc497cf8-109d-47e0-93a9-c02a1a24a1c0 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:49.816905 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc497cf8-109d-47e0-93a9-c02a1a24a1c0 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:49.817779 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc497cf8-109d-47e0-93a9-c02a1a24a1c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:49.823098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bc497cf8-109d-47e0-93a9-c02a1a24a1c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:49.938741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc497cf8-109d-47e0-93a9-c02a1a24a1c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:49.945617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc497cf8-109d-47e0-93a9-c02a1a24a1c0 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:49.962819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1136/2288] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:49.982688 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916bb32-c2b2-4708-8c44-d83d98586948 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:49.985822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c916bb32-c2b2-4708-8c44-d83d98586948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:50.129480 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916bb32-c2b2-4708-8c44-d83d98586948 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.140974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:50.141979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.142368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.142551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] PATH_INFO: `/v3/projects/40e8c89a7b5347e98a3df23cd1bfa364` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.145165 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e8c89a7b5347e98a3df23cd1bfa364)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:50.147346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:50.153774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc497cf8-109d-47e0-93a9-c02a1a24a1c0 service nova] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:50.156961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bc497cf8-109d-47e0-93a9-c02a1a24a1c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:50.184113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc497cf8-109d-47e0-93a9-c02a1a24a1c0 service nova] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.194434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:50.195558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.196009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.196326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] PATH_INFO: `/v3/projects/b3f31c1122e5421d9e77c1598e2ea6b4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.198462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f31c1122e5421d9e77c1598e2ea6b4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:50.200734 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:50.240788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e8c89a7b5347e98a3df23cd1bfa364', 'request_id': 'req-9f88ee24-fc43-4f1c-8828-b6d026781644'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:50.249953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e8c89a7b5347e98a3df23cd1bfa364', 'request_id': 'req-9f88ee24-fc43-4f1c-8828-b6d026781644'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:50.279647 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e8c89a7b5347e98a3df23cd1bfa364', 'request_id': 'req-9f88ee24-fc43-4f1c-8828-b6d026781644'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:50.306919 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] The token cache is being invalidate because project 40e8c89a7b5347e98a3df23cd1bfa364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:50.307125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:50.310770 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f88ee24-fc43-4f1c-8828-b6d026781644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:50.315859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1153/2289] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:49 2022] DELETE /identity/v3/projects/40e8c89a7b5347e98a3df23cd1bfa364 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:50.319363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbb40b-8df4-4e17-8bfc-53703e8d72fc None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.320485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbb40b-8df4-4e17-8bfc-53703e8d72fc None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.320910 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbb40b-8df4-4e17-8bfc-53703e8d72fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.372685 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-03fbb40b-8df4-4e17-8bfc-53703e8d72fc None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:50.374395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-03fbb40b-8df4-4e17-8bfc-53703e8d72fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:50.379460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f31c1122e5421d9e77c1598e2ea6b4', 'request_id': 'req-88826abe-d002-4c5c-8d68-1f897d5812e3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:50.390520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f31c1122e5421d9e77c1598e2ea6b4', 'request_id': 'req-88826abe-d002-4c5c-8d68-1f897d5812e3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:50.409460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f31c1122e5421d9e77c1598e2ea6b4', 'request_id': 'req-88826abe-d002-4c5c-8d68-1f897d5812e3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:50.429191 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] The token cache is being invalidate because project b3f31c1122e5421d9e77c1598e2ea6b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:50.429654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:50.430912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-88826abe-d002-4c5c-8d68-1f897d5812e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:50.432092 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1137/2290] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:50 2022] DELETE /identity/v3/projects/b3f31c1122e5421d9e77c1598e2ea6b4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:50.438012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b13119-f178-4f26-a04d-fba42ad13c60 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.439520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b13119-f178-4f26-a04d-fba42ad13c60 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.439802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b13119-f178-4f26-a04d-fba42ad13c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.474888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-50b13119-f178-4f26-a04d-fba42ad13c60 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:50.476364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-50b13119-f178-4f26-a04d-fba42ad13c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:50.484144 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1154/2291] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:50.486891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97da975-ca7c-4939-a94a-9ead1feff265 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.487484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97da975-ca7c-4939-a94a-9ead1feff265 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.488572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97da975-ca7c-4939-a94a-9ead1feff265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.489231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1138/2292] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:50.497523 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc70c6-c02d-4629-8749-eadbd90a538c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.497896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc70c6-c02d-4629-8749-eadbd90a538c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.498284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc70c6-c02d-4629-8749-eadbd90a538c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.518854 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-53fc70c6-c02d-4629-8749-eadbd90a538c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:50.520142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-53fc70c6-c02d-4629-8749-eadbd90a538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:50.528224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d97da975-ca7c-4939-a94a-9ead1feff265 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:50.529024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1139/2293] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:50.530042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d97da975-ca7c-4939-a94a-9ead1feff265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:50.537058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc70c6-c02d-4629-8749-eadbd90a538c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:50.547248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc70c6-c02d-4629-8749-eadbd90a538c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.552206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22dc2a-631e-40f8-a4f8-ad39eba69c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:50.553071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22dc2a-631e-40f8-a4f8-ad39eba69c33 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.553435 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22dc2a-631e-40f8-a4f8-ad39eba69c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.553899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22dc2a-631e-40f8-a4f8-ad39eba69c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.554430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1155/2294] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:50.554944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22dc2a-631e-40f8-a4f8-ad39eba69c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:50.555508 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22dc2a-631e-40f8-a4f8-ad39eba69c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:50.557251 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22dc2a-631e-40f8-a4f8-ad39eba69c33 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:50.559676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97da975-ca7c-4939-a94a-9ead1feff265 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:50.572551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1140/2295] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:50.575903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97da975-ca7c-4939-a94a-9ead1feff265 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.577015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22dc2a-631e-40f8-a4f8-ad39eba69c33 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:50.591458 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc8e2d-cdcd-44cd-a62a-8101e2d62727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:50.592187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc8e2d-cdcd-44cd-a62a-8101e2d62727 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.593886 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc8e2d-cdcd-44cd-a62a-8101e2d62727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.593886 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc8e2d-cdcd-44cd-a62a-8101e2d62727 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.594519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc8e2d-cdcd-44cd-a62a-8101e2d62727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:50.594823 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc8e2d-cdcd-44cd-a62a-8101e2d62727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:50.597416 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc8e2d-cdcd-44cd-a62a-8101e2d62727 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:50.602934 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22dc2a-631e-40f8-a4f8-ad39eba69c33 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.625364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878170ea-5536-4cf4-b1dc-d04c3f4ea660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:50.626048 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878170ea-5536-4cf4-b1dc-d04c3f4ea660 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.626421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878170ea-5536-4cf4-b1dc-d04c3f4ea660 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.626615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878170ea-5536-4cf4-b1dc-d04c3f4ea660 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.629300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878170ea-5536-4cf4-b1dc-d04c3f4ea660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:50.631261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878170ea-5536-4cf4-b1dc-d04c3f4ea660 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:50.648928 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1156/2296] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:50.653082 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc8e2d-cdcd-44cd-a62a-8101e2d62727 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:50.670025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc8e2d-cdcd-44cd-a62a-8101e2d62727 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.682817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd924c-6e74-424e-842e-e94dc11eb561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:50.683615 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd924c-6e74-424e-842e-e94dc11eb561 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.683783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd924c-6e74-424e-842e-e94dc11eb561 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.684050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd924c-6e74-424e-842e-e94dc11eb561 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.684752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd924c-6e74-424e-842e-e94dc11eb561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:50.686904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd924c-6e74-424e-842e-e94dc11eb561 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:50.735155 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1141/2297] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:50 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:50.746313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1157/2298] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:50 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:50.750746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd924c-6e74-424e-842e-e94dc11eb561 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:50.752804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878170ea-5536-4cf4-b1dc-d04c3f4ea660 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:50.865505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd924c-6e74-424e-842e-e94dc11eb561 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.873234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075f7b8-9e02-412a-8cc5-5b1cba684595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:50.874450 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075f7b8-9e02-412a-8cc5-5b1cba684595 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.875040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075f7b8-9e02-412a-8cc5-5b1cba684595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.875498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075f7b8-9e02-412a-8cc5-5b1cba684595 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.876354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075f7b8-9e02-412a-8cc5-5b1cba684595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:50.879306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075f7b8-9e02-412a-8cc5-5b1cba684595 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:50.890422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878170ea-5536-4cf4-b1dc-d04c3f4ea660 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.902599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82951323-9630-43fc-bebe-3bdc5b980ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:50.905571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82951323-9630-43fc-bebe-3bdc5b980ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.906266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82951323-9630-43fc-bebe-3bdc5b980ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.908940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82951323-9630-43fc-bebe-3bdc5b980ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.909943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82951323-9630-43fc-bebe-3bdc5b980ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:50.917420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1158/2299] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:50 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:50.918447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075f7b8-9e02-412a-8cc5-5b1cba684595 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:50.919540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82951323-9630-43fc-bebe-3bdc5b980ad3 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:50.941405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075f7b8-9e02-412a-8cc5-5b1cba684595 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.952239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574e725-5adb-4ba6-a032-f758aff3f8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:50.953354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574e725-5adb-4ba6-a032-f758aff3f8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.953845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574e725-5adb-4ba6-a032-f758aff3f8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.954304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574e725-5adb-4ba6-a032-f758aff3f8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.955319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574e725-5adb-4ba6-a032-f758aff3f8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:50.957431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574e725-5adb-4ba6-a032-f758aff3f8e9 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:50.961677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1142/2300] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:50 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:50.966121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82951323-9630-43fc-bebe-3bdc5b980ad3 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:50.975743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1159/2301] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:50.980673 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574e725-5adb-4ba6-a032-f758aff3f8e9 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:50.984710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82951323-9630-43fc-bebe-3bdc5b980ad3 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.992955 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3ae24-e4a7-40a5-b047-e293f97ac4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:50.994109 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3ae24-e4a7-40a5-b047-e293f97ac4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:50.994545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574e725-5adb-4ba6-a032-f758aff3f8e9 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:50.994985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3ae24-e4a7-40a5-b047-e293f97ac4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:50.994985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3ae24-e4a7-40a5-b047-e293f97ac4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:50.996347 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3ae24-e4a7-40a5-b047-e293f97ac4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:50.997834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3ae24-e4a7-40a5-b047-e293f97ac4d9 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:50.999569 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d0899-45e2-4514-a6f5-4867f3d265b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:51.000453 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0899-45e2-4514-a6f5-4867f3d265b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.000928 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0899-45e2-4514-a6f5-4867f3d265b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.001381 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0899-45e2-4514-a6f5-4867f3d265b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.002304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d0899-45e2-4514-a6f5-4867f3d265b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:51.004113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d0899-45e2-4514-a6f5-4867f3d265b6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:51.010917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1143/2302] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:51.014608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1160/2303] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:51.014924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3ae24-e4a7-40a5-b047-e293f97ac4d9 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:51.019540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d0899-45e2-4514-a6f5-4867f3d265b6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:51.028635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3ae24-e4a7-40a5-b047-e293f97ac4d9 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:51.038640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee97a-5ac7-4c97-8811-25d80910d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:51.038807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d0899-45e2-4514-a6f5-4867f3d265b6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:51.041149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee97a-5ac7-4c97-8811-25d80910d4fa admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.041951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee97a-5ac7-4c97-8811-25d80910d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.043009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee97a-5ac7-4c97-8811-25d80910d4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.043458 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b805a1f-d467-4a16-8829-915aa513a227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:51.044717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b805a1f-d467-4a16-8829-915aa513a227 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.045311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b805a1f-d467-4a16-8829-915aa513a227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.045713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b805a1f-d467-4a16-8829-915aa513a227 admin admin] PATH_INFO: `/v3/projects/bce20faa32424dd19334cfdf45c1b69e/users/77569e15086441b48145182c353d3d0f/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.045839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacee97a-5ac7-4c97-8811-25d80910d4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:51.053994 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacee97a-5ac7-4c97-8811-25d80910d4fa admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:51.070362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b805a1f-d467-4a16-8829-915aa513a227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce20faa32424dd19334cfdf45c1b69e, user_id=77569e15086441b48145182c353d3d0f, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:51.073745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b805a1f-d467-4a16-8829-915aa513a227 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:51.087516 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1144/2304] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:51.090712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee97a-5ac7-4c97-8811-25d80910d4fa admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:51.103192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1161/2305] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:51 2022] PUT /identity/v3/projects/bce20faa32424dd19334cfdf45c1b69e/users/77569e15086441b48145182c353d3d0f/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:51.115710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4408b-2183-499e-a72b-e6fe4ea8ad93 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.116579 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4408b-2183-499e-a72b-e6fe4ea8ad93 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.117171 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4408b-2183-499e-a72b-e6fe4ea8ad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.144231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee97a-5ac7-4c97-8811-25d80910d4fa admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:51.213363 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-a9d4408b-2183-499e-a72b-e6fe4ea8ad93 None None] MFA Rules not processed for user `77569e15086441b48145182c353d3d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:51.216147 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-a9d4408b-2183-499e-a72b-e6fe4ea8ad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:51.325828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c1128-3ce8-49b5-b319-7651a28464f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:51.327795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c1128-3ce8-49b5-b319-7651a28464f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.329521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c1128-3ce8-49b5-b319-7651a28464f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.330422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c1128-3ce8-49b5-b319-7651a28464f6 admin admin] PATH_INFO: `/v3/projects/3b0d6bdc5136421792ba72516aa75ba2/users/9b6aabdc3b9b4a588e14277fc9a52fa0/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.354551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1162/2306] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:51.363869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4408b-2183-499e-a72b-e6fe4ea8ad93 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:51.365718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-a9d4408b-2183-499e-a72b-e6fe4ea8ad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:51.370675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c1128-3ce8-49b5-b319-7651a28464f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0d6bdc5136421792ba72516aa75ba2, user_id=9b6aabdc3b9b4a588e14277fc9a52fa0, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:51.379935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c1128-3ce8-49b5-b319-7651a28464f6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:51.407475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1145/2307] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:51 2022] PUT /identity/v3/projects/3b0d6bdc5136421792ba72516aa75ba2/users/9b6aabdc3b9b4a588e14277fc9a52fa0/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:51.413108 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74b38-529e-4328-b216-3feb5cbe1904 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.413455 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74b38-529e-4328-b216-3feb5cbe1904 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.413789 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74b38-529e-4328-b216-3feb5cbe1904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.471222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-89a74b38-529e-4328-b216-3feb5cbe1904 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:51.472488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-89a74b38-529e-4328-b216-3feb5cbe1904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:51.535719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4408b-2183-499e-a72b-e6fe4ea8ad93 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:51.584724 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1146/2308] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:51.592597 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74b38-529e-4328-b216-3feb5cbe1904 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:51.597722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-89a74b38-529e-4328-b216-3feb5cbe1904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:51.612839 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74b38-529e-4328-b216-3feb5cbe1904 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:51.620411 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:51.621162 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.621518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.621978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] PATH_INFO: `/v3/users/54c81f1c877e463c829f7ca4c832a8fc` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.623439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c81f1c877e463c829f7ca4c832a8fc)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:51.624220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca754a1c-9327-4692-9cbe-5eff80c6a702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:51.625472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca754a1c-9327-4692-9cbe-5eff80c6a702 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.625593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:51.626769 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca754a1c-9327-4692-9cbe-5eff80c6a702 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.627266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca754a1c-9327-4692-9cbe-5eff80c6a702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.709979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c81f1c877e463c829f7ca4c832a8fc'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:51.718967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca754a1c-9327-4692-9cbe-5eff80c6a702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:51.721055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca754a1c-9327-4692-9cbe-5eff80c6a702 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:51.728330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c81f1c877e463c829f7ca4c832a8fc'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:51.729514 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c81f1c877e463c829f7ca4c832a8fc'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:51.731141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1163/2309] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:51.740421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c81f1c877e463c829f7ca4c832a8fc'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:51.741265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c81f1c877e463c829f7ca4c832a8fc'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:51.741505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca754a1c-9327-4692-9cbe-5eff80c6a702 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:51.745019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ca754a1c-9327-4692-9cbe-5eff80c6a702 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:51.765269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1147/2310] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:51 2022] DELETE /identity/v3/users/54c81f1c877e463c829f7ca4c832a8fc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:51.766240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:51.767759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:51.808141 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca754a1c-9327-4692-9cbe-5eff80c6a702 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:51.867071 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bc8ec-cf9d-43a7-b137-8205f9bd028f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:51.872584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:51.873766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.874385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.874888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] PATH_INFO: `/v3/users/77569e15086441b48145182c353d3d0f` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.876325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=77569e15086441b48145182c353d3d0f)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:51.878421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:51.881878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2093-507f-4678-ae59-794b5708e172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:51.882837 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2093-507f-4678-ae59-794b5708e172 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.883700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2093-507f-4678-ae59-794b5708e172 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.884627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2093-507f-4678-ae59-794b5708e172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.886624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5cef2093-507f-4678-ae59-794b5708e172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:51.899763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef2093-507f-4678-ae59-794b5708e172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:51.901355 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef2093-507f-4678-ae59-794b5708e172 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:51.916140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1164/2311] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:51.917804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb352-785d-4394-866c-6f38e424130d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.918170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb352-785d-4394-866c-6f38e424130d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.918544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb352-785d-4394-866c-6f38e424130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.950900 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4a7bb352-785d-4394-866c-6f38e424130d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:51.952510 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4a7bb352-785d-4394-866c-6f38e424130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:51.964618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1165/2312] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:51.976489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf47f8-a7ae-4064-8cab-64967f4ed300 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:51.976747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf47f8-a7ae-4064-8cab-64967f4ed300 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:51.977030 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf47f8-a7ae-4064-8cab-64967f4ed300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:51.978060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77569e15086441b48145182c353d3d0f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:52.004929 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77569e15086441b48145182c353d3d0f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:52.006547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-8baf47f8-a7ae-4064-8cab-64967f4ed300 None None] MFA Rules not processed for user `743564ffbc354c85814a07001a3c387e`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:52.008316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8baf47f8-a7ae-4064-8cab-64967f4ed300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:52.017676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77569e15086441b48145182c353d3d0f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:52.037722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77569e15086441b48145182c353d3d0f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:52.039128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77569e15086441b48145182c353d3d0f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:52.060556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1148/2313] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:51 2022] DELETE /identity/v3/users/77569e15086441b48145182c353d3d0f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:52.061725 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:52.066066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:52.098343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1166/2314] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:52.109767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b435-26b7-4eeb-aea0-f782e94aab3e None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:52.110054 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b435-26b7-4eeb-aea0-f782e94aab3e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:52.113200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b435-26b7-4eeb-aea0-f782e94aab3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:52.145766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd3e6f-0511-457e-b953-4f47db6943ef admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:52.150330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e3de7-e278-41d5-9b5f-05dd5853c25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:52.151319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e3de7-e278-41d5-9b5f-05dd5853c25a service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:52.151832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e3de7-e278-41d5-9b5f-05dd5853c25a service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:52.152208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e3de7-e278-41d5-9b5f-05dd5853c25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:52.163316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-615e3de7-e278-41d5-9b5f-05dd5853c25a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:52.168095 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4e81b435-26b7-4eeb-aea0-f782e94aab3e None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:52.170014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4e81b435-26b7-4eeb-aea0-f782e94aab3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:52.263220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e3de7-e278-41d5-9b5f-05dd5853c25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:52.267295 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e3de7-e278-41d5-9b5f-05dd5853c25a service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:52.282915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1149/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:52.368966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1167/2316] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:52.385701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e3de7-e278-41d5-9b5f-05dd5853c25a service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:52.402904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e3de7-e278-41d5-9b5f-05dd5853c25a service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:52.409789 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eef8f3-e5f2-4f46-9596-72d028ea0fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:52.410628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eef8f3-e5f2-4f46-9596-72d028ea0fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:52.411414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eef8f3-e5f2-4f46-9596-72d028ea0fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:52.411853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eef8f3-e5f2-4f46-9596-72d028ea0fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:52.435020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eef8f3-e5f2-4f46-9596-72d028ea0fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:52.437825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eef8f3-e5f2-4f46-9596-72d028ea0fd3 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:52.452211 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1150/2317] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:53:53.040342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81b435-26b7-4eeb-aea0-f782e94aab3e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:53.041762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4e81b435-26b7-4eeb-aea0-f782e94aab3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:53.062413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81b435-26b7-4eeb-aea0-f782e94aab3e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:53.082588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:53.085159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:53.085440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:53.085761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] PATH_INFO: `/v3/projects/03e7cddbb67443e3a51002e45822b559` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:53.087597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e7cddbb67443e3a51002e45822b559)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:53.093359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:53.180507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e7cddbb67443e3a51002e45822b559', 'request_id': 'req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.189227 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e7cddbb67443e3a51002e45822b559', 'request_id': 'req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.196201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eef8f3-e5f2-4f46-9596-72d028ea0fd3 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:53.199666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-47eef8f3-e5f2-4f46-9596-72d028ea0fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:53.201845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e7cddbb67443e3a51002e45822b559', 'request_id': 'req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.214524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eef8f3-e5f2-4f46-9596-72d028ea0fd3 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:53.218189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] The token cache is being invalidate because project 03e7cddbb67443e3a51002e45822b559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:53.218685 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.219512 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac6442bf-b19c-4cf4-9e26-9dbb09f01888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.221989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1168/2318] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:53 2022] DELETE /identity/v3/projects/03e7cddbb67443e3a51002e45822b559 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:53.223607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55511f9-d40c-48e7-9a83-c21f9c1bb380 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:53.224154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55511f9-d40c-48e7-9a83-c21f9c1bb380 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:53.225124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55511f9-d40c-48e7-9a83-c21f9c1bb380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:53.259507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b55511f9-d40c-48e7-9a83-c21f9c1bb380 None None] MFA Rules not processed for user `9b6aabdc3b9b4a588e14277fc9a52fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:53.261672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b55511f9-d40c-48e7-9a83-c21f9c1bb380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:53.301872 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:53.303802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:53.304082 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:53.304465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] PATH_INFO: `/v3/projects/bce20faa32424dd19334cfdf45c1b69e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:53.305948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce20faa32424dd19334cfdf45c1b69e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:53.308425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:53.355313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1169/2319] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:53.356195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55511f9-d40c-48e7-9a83-c21f9c1bb380 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:53.357480 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b55511f9-d40c-48e7-9a83-c21f9c1bb380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:53.371954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55511f9-d40c-48e7-9a83-c21f9c1bb380 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:53.393733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce20faa32424dd19334cfdf45c1b69e', 'request_id': 'req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.400927 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce20faa32424dd19334cfdf45c1b69e', 'request_id': 'req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.411327 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce20faa32424dd19334cfdf45c1b69e', 'request_id': 'req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.424605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] The token cache is being invalidate because project bce20faa32424dd19334cfdf45c1b69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:53.425182 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.427953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.429762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1151/2320] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:53 2022] DELETE /identity/v3/projects/bce20faa32424dd19334cfdf45c1b69e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:53.430987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:53.432250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:53.465190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:53.467148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:53.467514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:53.468288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] PATH_INFO: `/v3/users/c8f09ba9779c4346826d92d694e718c4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:53.476623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f09ba9779c4346826d92d694e718c4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:53.481565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:53.558493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f09ba9779c4346826d92d694e718c4'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.570475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364fec-10a2-4b9a-9dde-d337f1ffcfd0 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:53.576747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe0345-f6dc-4ec0-ac89-b35b513ff614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:53.577479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0345-f6dc-4ec0-ac89-b35b513ff614 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:53.577925 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0345-f6dc-4ec0-ac89-b35b513ff614 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:53.578299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0345-f6dc-4ec0-ac89-b35b513ff614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:53.580823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cafe0345-f6dc-4ec0-ac89-b35b513ff614 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:53.584700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f09ba9779c4346826d92d694e718c4'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.586041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f09ba9779c4346826d92d694e718c4'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.587229 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f09ba9779c4346826d92d694e718c4'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.600676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f9351cae-3c5b-4eb7-b44c-2ff009961219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f09ba9779c4346826d92d694e718c4'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:53.617823 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1170/2321] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:53 2022] DELETE /identity/v3/users/c8f09ba9779c4346826d92d694e718c4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:53.619128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe572d-9202-4431-86ed-c625870661df None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:53.619437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe572d-9202-4431-86ed-c625870661df None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:53.619727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe572d-9202-4431-86ed-c625870661df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:53.682187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-08fe572d-9202-4431-86ed-c625870661df None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:53.684636 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-08fe572d-9202-4431-86ed-c625870661df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:53.688993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe0345-f6dc-4ec0-ac89-b35b513ff614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:53.701202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe0345-f6dc-4ec0-ac89-b35b513ff614 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:53.717366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1152/2322] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:53.835333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1171/2323] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:53.846572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae65220-fb5b-42bb-9df0-f8703aabf89c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:53.846959 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae65220-fb5b-42bb-9df0-f8703aabf89c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:53.847847 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae65220-fb5b-42bb-9df0-f8703aabf89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:53.893971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1ae65220-fb5b-42bb-9df0-f8703aabf89c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:53.895434 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1ae65220-fb5b-42bb-9df0-f8703aabf89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:53.923868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe572d-9202-4431-86ed-c625870661df None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:53.932486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1153/2324] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:53.936410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe572d-9202-4431-86ed-c625870661df None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:53.944401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac89808-9750-40d4-9318-4d65fc702b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:53.945275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac89808-9750-40d4-9318-4d65fc702b5f admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:53.945644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac89808-9750-40d4-9318-4d65fc702b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:53.946009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac89808-9750-40d4-9318-4d65fc702b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:53.946923 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac89808-9750-40d4-9318-4d65fc702b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:53.947322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac89808-9750-40d4-9318-4d65fc702b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:53.949890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac89808-9750-40d4-9318-4d65fc702b5f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:53.975867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae65220-fb5b-42bb-9df0-f8703aabf89c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:53.988849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae65220-fb5b-42bb-9df0-f8703aabf89c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:53.989462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1172/2325] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:54.006690 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839cffa-9b26-4381-ab50-7953ec717b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:54.007509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839cffa-9b26-4381-ab50-7953ec717b89 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:54.008155 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839cffa-9b26-4381-ab50-7953ec717b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:54.009322 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839cffa-9b26-4381-ab50-7953ec717b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:54.010296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839cffa-9b26-4381-ab50-7953ec717b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:54.018153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839cffa-9b26-4381-ab50-7953ec717b89 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:54.092288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1154/2326] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:53 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:54.094993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac89808-9750-40d4-9318-4d65fc702b5f admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:54.121677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac89808-9750-40d4-9318-4d65fc702b5f admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:54.264299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad04004-f3f6-4892-a61f-c3136635eac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:54.264706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04004-f3f6-4892-a61f-c3136635eac8 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:54.265103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04004-f3f6-4892-a61f-c3136635eac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:54.265390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04004-f3f6-4892-a61f-c3136635eac8 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:54.266407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad04004-f3f6-4892-a61f-c3136635eac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:54.268831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad04004-f3f6-4892-a61f-c3136635eac8 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:54.274910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839cffa-9b26-4381-ab50-7953ec717b89 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:54.276738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c839cffa-9b26-4381-ab50-7953ec717b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:54.305975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839cffa-9b26-4381-ab50-7953ec717b89 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:54.326910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:54.328365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:54.328860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:54.329275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] PATH_INFO: `/v3/projects/f083e3ee85ea40ba8c27e88381640e00` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:54.330841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f083e3ee85ea40ba8c27e88381640e00)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:54.333255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:54.358003 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1173/2327] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:54 2022] POST /identity/v3/users => generated 291 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:54.359245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad04004-f3f6-4892-a61f-c3136635eac8 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:54.389979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad04004-f3f6-4892-a61f-c3136635eac8 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:54.408745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06042b-0d61-421c-8908-b61891bb0839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:54.412142 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06042b-0d61-421c-8908-b61891bb0839 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:54.412545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06042b-0d61-421c-8908-b61891bb0839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:54.413401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06042b-0d61-421c-8908-b61891bb0839 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:54.415806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06042b-0d61-421c-8908-b61891bb0839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:54.435510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f083e3ee85ea40ba8c27e88381640e00', 'request_id': 'req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:54.435800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06042b-0d61-421c-8908-b61891bb0839 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:54.458875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f083e3ee85ea40ba8c27e88381640e00', 'request_id': 'req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:54.486243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f083e3ee85ea40ba8c27e88381640e00', 'request_id': 'req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:54.504227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] The token cache is being invalidate because project f083e3ee85ea40ba8c27e88381640e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:54.504227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:54.504932 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:54.510945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1155/2328] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:54 2022] DELETE /identity/v3/projects/f083e3ee85ea40ba8c27e88381640e00 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:54.515036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:54.518073 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:54.539342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1174/2329] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:54.547901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06042b-0d61-421c-8908-b61891bb0839 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:54.559214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-bb06042b-0d61-421c-8908-b61891bb0839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:54.612944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06042b-0d61-421c-8908-b61891bb0839 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:54.712841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89eb7f-44f0-4170-bfb4-db5c14e6d007 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:54.719061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:54.719969 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:54.720251 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:54.720527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] PATH_INFO: `/v3/users/77977d7b0ecc48d49717a8cf062b2365` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:54.721788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=77977d7b0ecc48d49717a8cf062b2365)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:54.724190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:54.744468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ff439-dc11-4f05-9278-1e414b399f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:54.745274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ff439-dc11-4f05-9278-1e414b399f00 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:54.745625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ff439-dc11-4f05-9278-1e414b399f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:54.745963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ff439-dc11-4f05-9278-1e414b399f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:54.747307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ff439-dc11-4f05-9278-1e414b399f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:54.749984 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ff439-dc11-4f05-9278-1e414b399f00 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:54.766515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1175/2330] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:54.775492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ff439-dc11-4f05-9278-1e414b399f00 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:54.791963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ff439-dc11-4f05-9278-1e414b399f00 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:54.798198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d8d9d-9d76-4a24-b7a7-b667139b9ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:54.799377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d8d9d-9d76-4a24-b7a7-b667139b9ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:54.799762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d8d9d-9d76-4a24-b7a7-b667139b9ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:54.800112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d8d9d-9d76-4a24-b7a7-b667139b9ddc admin admin] PATH_INFO: `/v3/projects/d863fb655bdd48fa99b9c1b9750dfb38/users/8d37da96f85e473fbc1d63337261dfea/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:54.808490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77977d7b0ecc48d49717a8cf062b2365'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:54.818931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d8d9d-9d76-4a24-b7a7-b667139b9ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d863fb655bdd48fa99b9c1b9750dfb38, user_id=8d37da96f85e473fbc1d63337261dfea, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:54.822417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d8d9d-9d76-4a24-b7a7-b667139b9ddc admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:54.824540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77977d7b0ecc48d49717a8cf062b2365'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:54.826103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77977d7b0ecc48d49717a8cf062b2365'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:54.838297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77977d7b0ecc48d49717a8cf062b2365'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:54.839212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77977d7b0ecc48d49717a8cf062b2365'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:54.840032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1176/2331] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:54 2022] PUT /identity/v3/projects/d863fb655bdd48fa99b9c1b9750dfb38/users/8d37da96f85e473fbc1d63337261dfea/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:54.846261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e95797-c954-4b80-9347-1ac2aa31a808 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:54.846634 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e95797-c954-4b80-9347-1ac2aa31a808 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:54.846979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e95797-c954-4b80-9347-1ac2aa31a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:54.858922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1156/2332] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:54 2022] DELETE /identity/v3/users/77977d7b0ecc48d49717a8cf062b2365 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:54.870449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-20e95797-c954-4b80-9347-1ac2aa31a808 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:54.871715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-20e95797-c954-4b80-9347-1ac2aa31a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:54.963130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1177/2333] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:54.981669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:54.983180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:55.073757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b1667-f5c2-4b7c-94f9-a76c5b53aa4d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:55.077812 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f3c9-838c-43ce-9547-d685ea3032b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:55.078721 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f3c9-838c-43ce-9547-d685ea3032b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:55.079092 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f3c9-838c-43ce-9547-d685ea3032b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:55.079332 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f3c9-838c-43ce-9547-d685ea3032b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:55.091289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f3c9-838c-43ce-9547-d685ea3032b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:55.092924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f3c9-838c-43ce-9547-d685ea3032b0 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:55.104532 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1157/2334] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:55.457725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e95797-c954-4b80-9347-1ac2aa31a808 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:55.459306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-20e95797-c954-4b80-9347-1ac2aa31a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:55.507372 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e95797-c954-4b80-9347-1ac2aa31a808 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:55.521966 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:55.523256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:55.523807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:55.524382 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] PATH_INFO: `/v3/projects/d5ecdeee2671486fab04d86adfe00dbe` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:55.529628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ecdeee2671486fab04d86adfe00dbe)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:55.533197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:55.678025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ecdeee2671486fab04d86adfe00dbe', 'request_id': 'req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:55.694216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ecdeee2671486fab04d86adfe00dbe', 'request_id': 'req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:55.719716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ecdeee2671486fab04d86adfe00dbe', 'request_id': 'req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:55.743105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] The token cache is being invalidate because project d5ecdeee2671486fab04d86adfe00dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:55.744014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:55.745402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-fe5b7c2e-c80d-4e7b-97b0-06ecca918512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:55.747998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1178/2335] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:55 2022] DELETE /identity/v3/projects/d5ecdeee2671486fab04d86adfe00dbe => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:55.755507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02d012-ae05-455e-a7a4-f6da8f6605bd None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:55.756395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02d012-ae05-455e-a7a4-f6da8f6605bd None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:55.756813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02d012-ae05-455e-a7a4-f6da8f6605bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:55.770433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78eefa-519f-4362-bc72-5d824466c828 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:55.770777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78eefa-519f-4362-bc72-5d824466c828 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:55.770978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78eefa-519f-4362-bc72-5d824466c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:55.795695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-6b02d012-ae05-455e-a7a4-f6da8f6605bd None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:55.797610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6e78eefa-519f-4362-bc72-5d824466c828 None None] MFA Rules not processed for user `9b6aabdc3b9b4a588e14277fc9a52fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:55.800464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6b02d012-ae05-455e-a7a4-f6da8f6605bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:55.801536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6e78eefa-519f-4362-bc72-5d824466c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:55.952145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1158/2336] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:55.952145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02d012-ae05-455e-a7a4-f6da8f6605bd None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:55.952145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6b02d012-ae05-455e-a7a4-f6da8f6605bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:55.957789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1179/2337] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:55.961368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb19af-b218-4a78-92bb-39957781448c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:55.961713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb19af-b218-4a78-92bb-39957781448c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:55.961892 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb19af-b218-4a78-92bb-39957781448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:55.973441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02d012-ae05-455e-a7a4-f6da8f6605bd None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:55.980104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:55.981292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:55.982496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:55.982945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] PATH_INFO: `/v3/users/344aff0b446f4ef6b5af5ecffcd5777e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:55.984940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] RBAC: Authorizing `identity:delete_user(user_id=344aff0b446f4ef6b5af5ecffcd5777e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:55.985224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-87eb19af-b218-4a78-92bb-39957781448c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:55.986600 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-87eb19af-b218-4a78-92bb-39957781448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:55.987639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:56.007474 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1180/2338] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:56.011957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb19af-b218-4a78-92bb-39957781448c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:56.050555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb19af-b218-4a78-92bb-39957781448c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:56.074458 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13929d-50ca-4738-8a8b-0d22f98403ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:56.075547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13929d-50ca-4738-8a8b-0d22f98403ee admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.077437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13929d-50ca-4738-8a8b-0d22f98403ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.077754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13929d-50ca-4738-8a8b-0d22f98403ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.078523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13929d-50ca-4738-8a8b-0d22f98403ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:56.078829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13929d-50ca-4738-8a8b-0d22f98403ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:56.084284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13929d-50ca-4738-8a8b-0d22f98403ee admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:56.097294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344aff0b446f4ef6b5af5ecffcd5777e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:56.116259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1181/2339] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:56.122277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13929d-50ca-4738-8a8b-0d22f98403ee admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:56.129586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344aff0b446f4ef6b5af5ecffcd5777e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:56.130862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344aff0b446f4ef6b5af5ecffcd5777e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:56.141339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13929d-50ca-4738-8a8b-0d22f98403ee admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:56.143320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344aff0b446f4ef6b5af5ecffcd5777e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:56.144368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f003a1df-6675-4d71-8e12-207b9d5a084d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344aff0b446f4ef6b5af5ecffcd5777e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:56.163390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b0a5f-a543-424d-a1c3-23c077f9aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:56.164753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b0a5f-a543-424d-a1c3-23c077f9aa42 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.165249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b0a5f-a543-424d-a1c3-23c077f9aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.165840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b0a5f-a543-424d-a1c3-23c077f9aa42 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.166807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b0a5f-a543-424d-a1c3-23c077f9aa42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:56.172272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1159/2340] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:55 2022] DELETE /identity/v3/users/344aff0b446f4ef6b5af5ecffcd5777e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:56.176608 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f8a8-0e52-42ab-8e66-0380b0112f86 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.176892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f8a8-0e52-42ab-8e66-0380b0112f86 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.177164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f8a8-0e52-42ab-8e66-0380b0112f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.193006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b0a5f-a543-424d-a1c3-23c077f9aa42 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:56.227215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-bca8f8a8-0e52-42ab-8e66-0380b0112f86 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:56.230063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bca8f8a8-0e52-42ab-8e66-0380b0112f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:56.278785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1182/2341] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:56 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:56.280536 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b0a5f-a543-424d-a1c3-23c077f9aa42 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:56.291452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-8a4b0a5f-a543-424d-a1c3-23c077f9aa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:56.379462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1160/2342] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:56.379462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaf44b-c13e-43a6-aec5-42c91a2e50e5 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.379462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaf44b-c13e-43a6-aec5-42c91a2e50e5 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.379462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaf44b-c13e-43a6-aec5-42c91a2e50e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.428446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-eacaf44b-c13e-43a6-aec5-42c91a2e50e5 None None] MFA Rules not processed for user `8d37da96f85e473fbc1d63337261dfea`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:56.429708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-eacaf44b-c13e-43a6-aec5-42c91a2e50e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:56.458549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b0a5f-a543-424d-a1c3-23c077f9aa42 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:56.472737 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0564-6e45-4b5d-a325-bacba74ab6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:56.473454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0564-6e45-4b5d-a325-bacba74ab6ce admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.476860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0564-6e45-4b5d-a325-bacba74ab6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.477432 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0564-6e45-4b5d-a325-bacba74ab6ce admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.478387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c0564-6e45-4b5d-a325-bacba74ab6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:56.481349 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c0564-6e45-4b5d-a325-bacba74ab6ce admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:56.516907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1183/2343] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:56 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:56.518257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0564-6e45-4b5d-a325-bacba74ab6ce admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:56.523597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-242c0564-6e45-4b5d-a325-bacba74ab6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:56.542137 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1161/2344] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:56.544574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaf44b-c13e-43a6-aec5-42c91a2e50e5 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:56.563692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaf44b-c13e-43a6-aec5-42c91a2e50e5 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:56.573177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c61bc2-27fc-4f92-b599-213e4d8d1d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:56.574252 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c61bc2-27fc-4f92-b599-213e4d8d1d3e admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.575209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c61bc2-27fc-4f92-b599-213e4d8d1d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.575648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c61bc2-27fc-4f92-b599-213e4d8d1d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.576573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c61bc2-27fc-4f92-b599-213e4d8d1d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:56.579462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c61bc2-27fc-4f92-b599-213e4d8d1d3e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:56.603216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1162/2345] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:56.606533 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c61bc2-27fc-4f92-b599-213e4d8d1d3e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:56.610706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-42c61bc2-27fc-4f92-b599-213e4d8d1d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:56.621160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0564-6e45-4b5d-a325-bacba74ab6ce admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:56.631869 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377afee4-8d1c-4eb7-a3b4-d9ef96e8537b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:56.632618 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377afee4-8d1c-4eb7-a3b4-d9ef96e8537b service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.633039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377afee4-8d1c-4eb7-a3b4-d9ef96e8537b service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.633318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377afee4-8d1c-4eb7-a3b4-d9ef96e8537b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.657010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377afee4-8d1c-4eb7-a3b4-d9ef96e8537b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:56.658749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377afee4-8d1c-4eb7-a3b4-d9ef96e8537b service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:56.680783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1184/2346] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:56.681654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377afee4-8d1c-4eb7-a3b4-d9ef96e8537b service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:56.695074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377afee4-8d1c-4eb7-a3b4-d9ef96e8537b service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:56.700069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c61bc2-27fc-4f92-b599-213e4d8d1d3e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:56.701845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdcb1e-6467-4b6f-a478-f8e7fa53e617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:56.702690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdcb1e-6467-4b6f-a478-f8e7fa53e617 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.702996 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdcb1e-6467-4b6f-a478-f8e7fa53e617 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.703368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdcb1e-6467-4b6f-a478-f8e7fa53e617 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.704140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdcb1e-6467-4b6f-a478-f8e7fa53e617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:56.705875 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdcb1e-6467-4b6f-a478-f8e7fa53e617 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:56.712275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c67bb1-4fdd-45c2-92c4-953804944020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:56.714098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c67bb1-4fdd-45c2-92c4-953804944020 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.714326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c67bb1-4fdd-45c2-92c4-953804944020 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.715067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c67bb1-4fdd-45c2-92c4-953804944020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.722165 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1185/2347] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:56.723856 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdcb1e-6467-4b6f-a478-f8e7fa53e617 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:56.725519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c67bb1-4fdd-45c2-92c4-953804944020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:56.727179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c67bb1-4fdd-45c2-92c4-953804944020 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:56.736375 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdcb1e-6467-4b6f-a478-f8e7fa53e617 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:56.743087 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477a4e3-f0ab-4ba3-ac25-d1a4df31b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:56.744717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477a4e3-f0ab-4ba3-ac25-d1a4df31b7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.745159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477a4e3-f0ab-4ba3-ac25-d1a4df31b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.745588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477a4e3-f0ab-4ba3-ac25-d1a4df31b7ce admin admin] PATH_INFO: `/v3/projects/04a7af65767c49d2ae20e95b0fe39691/users/d501be50ac5c4f53a1b70d7dd4e43472/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.750452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1163/2348] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:56.766730 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477a4e3-f0ab-4ba3-ac25-d1a4df31b7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a7af65767c49d2ae20e95b0fe39691, user_id=d501be50ac5c4f53a1b70d7dd4e43472, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:56.770115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477a4e3-f0ab-4ba3-ac25-d1a4df31b7ce admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:56.794208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1186/2349] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:56 2022] PUT /identity/v3/projects/04a7af65767c49d2ae20e95b0fe39691/users/d501be50ac5c4f53a1b70d7dd4e43472/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:56.799045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2b836-d5cc-40aa-b748-2557f00f8829 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:56.799578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2b836-d5cc-40aa-b748-2557f00f8829 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:56.799905 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2b836-d5cc-40aa-b748-2557f00f8829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:56.825423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b3d2b836-d5cc-40aa-b748-2557f00f8829 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:56.826893 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b3d2b836-d5cc-40aa-b748-2557f00f8829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:56.900687 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1164/2350] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:56.912980 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477a4e3-f0ab-4ba3-ac25-d1a4df31b7ce admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:56.914774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9477a4e3-f0ab-4ba3-ac25-d1a4df31b7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:57.036577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477a4e3-f0ab-4ba3-ac25-d1a4df31b7ce admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:57.041926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c24f8-4647-4a7c-852f-c1f7b5667e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:57.042957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c24f8-4647-4a7c-852f-c1f7b5667e0e service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:57.043441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c24f8-4647-4a7c-852f-c1f7b5667e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:57.044213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c24f8-4647-4a7c-852f-c1f7b5667e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:57.055922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c24f8-4647-4a7c-852f-c1f7b5667e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:57.058056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c24f8-4647-4a7c-852f-c1f7b5667e0e service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:57.071775 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1187/2351] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:57.593363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2b836-d5cc-40aa-b748-2557f00f8829 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:57.595227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b3d2b836-d5cc-40aa-b748-2557f00f8829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:57.608559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2b836-d5cc-40aa-b748-2557f00f8829 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:57.627712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:57.628677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:57.630121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:57.630507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] PATH_INFO: `/v3/projects/2f4f538802af4de58bbfe8714c2554c6` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:57.635073 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4f538802af4de58bbfe8714c2554c6)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:57.648132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:57.773036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4f538802af4de58bbfe8714c2554c6', 'request_id': 'req-252e9025-c0dc-405d-bc38-809d331ff0f5'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:57.788098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4f538802af4de58bbfe8714c2554c6', 'request_id': 'req-252e9025-c0dc-405d-bc38-809d331ff0f5'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:57.799610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4f538802af4de58bbfe8714c2554c6', 'request_id': 'req-252e9025-c0dc-405d-bc38-809d331ff0f5'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:57.826944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] The token cache is being invalidate because project 2f4f538802af4de58bbfe8714c2554c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:57.827441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:57.828365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-252e9025-c0dc-405d-bc38-809d331ff0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:57.830593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1165/2352] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:57 2022] DELETE /identity/v3/projects/2f4f538802af4de58bbfe8714c2554c6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:58.272840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf401031-82a7-4a9b-9c50-6d16b1ff1733 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:58.273353 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf401031-82a7-4a9b-9c50-6d16b1ff1733 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:58.273431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf401031-82a7-4a9b-9c50-6d16b1ff1733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:58.315308 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-cf401031-82a7-4a9b-9c50-6d16b1ff1733 None None] MFA Rules not processed for user `d501be50ac5c4f53a1b70d7dd4e43472`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:58.316874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-cf401031-82a7-4a9b-9c50-6d16b1ff1733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:58.372894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe682a51-502b-4b1c-bee1-9d8ac5b3b3c1 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:58.373568 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe682a51-502b-4b1c-bee1-9d8ac5b3b3c1 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:58.373995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe682a51-502b-4b1c-bee1-9d8ac5b3b3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:58.397052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-fe682a51-502b-4b1c-bee1-9d8ac5b3b3c1 None None] MFA Rules not processed for user `8d37da96f85e473fbc1d63337261dfea`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:58.399182 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-fe682a51-502b-4b1c-bee1-9d8ac5b3b3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:58.416018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1188/2353] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:58.420621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf401031-82a7-4a9b-9c50-6d16b1ff1733 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:58.422287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-cf401031-82a7-4a9b-9c50-6d16b1ff1733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:58.470318 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1166/2354] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:53:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:58.606282 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf401031-82a7-4a9b-9c50-6d16b1ff1733 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:58.616571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c451ac1-076f-489e-9715-42fd89017225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:58.617587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c451ac1-076f-489e-9715-42fd89017225 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:58.618044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c451ac1-076f-489e-9715-42fd89017225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:58.618712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c451ac1-076f-489e-9715-42fd89017225 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:58.619832 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c451ac1-076f-489e-9715-42fd89017225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:58.628905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c451ac1-076f-489e-9715-42fd89017225 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:58.688268 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1189/2355] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:58 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:58.688504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe682a51-502b-4b1c-bee1-9d8ac5b3b3c1 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:58.707983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe682a51-502b-4b1c-bee1-9d8ac5b3b3c1 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:58.790052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e080cf-da30-47ba-8bae-1fdaf394ad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:58.790926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e080cf-da30-47ba-8bae-1fdaf394ad0f admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:58.791273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e080cf-da30-47ba-8bae-1fdaf394ad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:58.791609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e080cf-da30-47ba-8bae-1fdaf394ad0f admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:58.792479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e080cf-da30-47ba-8bae-1fdaf394ad0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:58.794485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e080cf-da30-47ba-8bae-1fdaf394ad0f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:58.821520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1167/2356] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:58 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:53:58.825852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c451ac1-076f-489e-9715-42fd89017225 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:58.840589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c451ac1-076f-489e-9715-42fd89017225 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:58.845406 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afa261-38cf-4152-9994-cb4cd08ffbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:58.846228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afa261-38cf-4152-9994-cb4cd08ffbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:58.846522 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afa261-38cf-4152-9994-cb4cd08ffbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:58.846797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afa261-38cf-4152-9994-cb4cd08ffbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:58.848262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afa261-38cf-4152-9994-cb4cd08ffbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:58.849944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afa261-38cf-4152-9994-cb4cd08ffbe4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:58.862447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1190/2357] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:58.866466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e080cf-da30-47ba-8bae-1fdaf394ad0f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:58.877412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e080cf-da30-47ba-8bae-1fdaf394ad0f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:58.883098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb1bab-ee35-41de-8e1c-6baff4372349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:58.884247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1bab-ee35-41de-8e1c-6baff4372349 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:58.884743 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1bab-ee35-41de-8e1c-6baff4372349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:58.885726 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1bab-ee35-41de-8e1c-6baff4372349 admin admin] PATH_INFO: `/v3/projects/7f1a69d419ab40179710eac879a52392/users/4f0a865658144936b26d16afe0a6139a/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:58.904580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1bab-ee35-41de-8e1c-6baff4372349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1a69d419ab40179710eac879a52392, user_id=4f0a865658144936b26d16afe0a6139a, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:58.907674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1bab-ee35-41de-8e1c-6baff4372349 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:58.923143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1168/2358] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:58 2022] PUT /identity/v3/projects/7f1a69d419ab40179710eac879a52392/users/4f0a865658144936b26d16afe0a6139a/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:53:58.928008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afa261-38cf-4152-9994-cb4cd08ffbe4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:58.942873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afa261-38cf-4152-9994-cb4cd08ffbe4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:59.022382 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149f4b3-4455-4c5e-92f8-9778c2f454ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:59.023301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149f4b3-4455-4c5e-92f8-9778c2f454ec admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:59.023850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149f4b3-4455-4c5e-92f8-9778c2f454ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:59.024284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149f4b3-4455-4c5e-92f8-9778c2f454ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:59.025230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149f4b3-4455-4c5e-92f8-9778c2f454ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:59.027034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149f4b3-4455-4c5e-92f8-9778c2f454ec admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:59.041184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1191/2359] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:53:59.045317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb1bab-ee35-41de-8e1c-6baff4372349 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:59.059366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb1bab-ee35-41de-8e1c-6baff4372349 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:59.065158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d9ded-5b56-4373-85b4-6e1464c79b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:59.066376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d9ded-5b56-4373-85b4-6e1464c79b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:59.066804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d9ded-5b56-4373-85b4-6e1464c79b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:59.067242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d9ded-5b56-4373-85b4-6e1464c79b95 admin admin] PATH_INFO: `/v3/projects/7f1a69d419ab40179710eac879a52392/users/4f0a865658144936b26d16afe0a6139a/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:59.070359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d9ded-5b56-4373-85b4-6e1464c79b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1a69d419ab40179710eac879a52392, user_id=4f0a865658144936b26d16afe0a6139a, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:59.073317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d9ded-5b56-4373-85b4-6e1464c79b95 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:59.085528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1169/2360] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:59 2022] PUT /identity/v3/projects/7f1a69d419ab40179710eac879a52392/users/4f0a865658144936b26d16afe0a6139a/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:54:00.348776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f3d39-317c-4383-9715-394d6435ae53 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:00.349256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f3d39-317c-4383-9715-394d6435ae53 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:00.349352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f3d39-317c-4383-9715-394d6435ae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:00.409376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ac7f3d39-317c-4383-9715-394d6435ae53 None None] MFA Rules not processed for user `4f0a865658144936b26d16afe0a6139a`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:00.411632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ac7f3d39-317c-4383-9715-394d6435ae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:00.507891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1192/2361] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:00.524556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d9ded-5b56-4373-85b4-6e1464c79b95 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:00.527260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-241d9ded-5b56-4373-85b4-6e1464c79b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:00.626849 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d9ded-5b56-4373-85b4-6e1464c79b95 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:00.634308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127323e3-f25c-4606-b5f0-7b088051c7ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:00.635622 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127323e3-f25c-4606-b5f0-7b088051c7ab service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:00.636069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127323e3-f25c-4606-b5f0-7b088051c7ab service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:00.636492 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127323e3-f25c-4606-b5f0-7b088051c7ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:00.732436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127323e3-f25c-4606-b5f0-7b088051c7ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:00.734008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127323e3-f25c-4606-b5f0-7b088051c7ab service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:00.746282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1170/2362] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:54:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:54:01.291633 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f3d39-317c-4383-9715-394d6435ae53 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:01.293936 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ac7f3d39-317c-4383-9715-394d6435ae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:01.361838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f3d39-317c-4383-9715-394d6435ae53 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:01.366419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:01.367312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:01.367585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:01.367976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] PATH_INFO: `/v3/users/2585c34309964e04b69e75f7d91baf25` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:01.369187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2585c34309964e04b69e75f7d91baf25)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:01.371134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:01.426676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2585c34309964e04b69e75f7d91baf25'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:01.439235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2585c34309964e04b69e75f7d91baf25'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:01.440059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2585c34309964e04b69e75f7d91baf25'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:01.440725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2585c34309964e04b69e75f7d91baf25'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:01.449976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-987e1cc0-d3cb-4c2b-86e9-75d23c547ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2585c34309964e04b69e75f7d91baf25'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:01.463535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1193/2363] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:54:01 2022] DELETE /identity/v3/users/2585c34309964e04b69e75f7d91baf25 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:54:01.665565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127323e3-f25c-4606-b5f0-7b088051c7ab service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:01.680363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127323e3-f25c-4606-b5f0-7b088051c7ab service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:01.754342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:01.755527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:01.756001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:01.756376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] PATH_INFO: `/v3/projects/79689d6f11a742d7b30e8d2081334602` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:01.758045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=79689d6f11a742d7b30e8d2081334602)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:01.760217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:01.834734 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79689d6f11a742d7b30e8d2081334602', 'request_id': 'req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:01.844144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79689d6f11a742d7b30e8d2081334602', 'request_id': 'req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:01.857733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79689d6f11a742d7b30e8d2081334602', 'request_id': 'req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:01.870996 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] The token cache is being invalidate because project 79689d6f11a742d7b30e8d2081334602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:54:01.871279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:01.872199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4304ee20-6d47-40e2-a6ce-7bc0f4adb8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:01.874345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1171/2364] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:54:01 2022] DELETE /identity/v3/projects/79689d6f11a742d7b30e8d2081334602 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:54:01.880523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad01da-fdd3-4e19-a0f4-a066c0acc0bd None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:01.881092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad01da-fdd3-4e19-a0f4-a066c0acc0bd None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:01.882000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad01da-fdd3-4e19-a0f4-a066c0acc0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:01.920862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-d9ad01da-fdd3-4e19-a0f4-a066c0acc0bd None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:01.922279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d9ad01da-fdd3-4e19-a0f4-a066c0acc0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:01.996902 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1194/2365] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:54:02.006096 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef21b03-c3ca-4f0d-8a9e-8a89252aca68 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:02.006395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef21b03-c3ca-4f0d-8a9e-8a89252aca68 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:02.006725 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef21b03-c3ca-4f0d-8a9e-8a89252aca68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:02.025908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-2ef21b03-c3ca-4f0d-8a9e-8a89252aca68 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:02.027442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2ef21b03-c3ca-4f0d-8a9e-8a89252aca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:02.038353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1172/2366] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:02.042889 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad01da-fdd3-4e19-a0f4-a066c0acc0bd None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:02.054361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad01da-fdd3-4e19-a0f4-a066c0acc0bd None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:02.059036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8fda5-6d94-483c-a65f-58e77abfd91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:02.059715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8fda5-6d94-483c-a65f-58e77abfd91b admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:02.059997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8fda5-6d94-483c-a65f-58e77abfd91b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:02.060420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8fda5-6d94-483c-a65f-58e77abfd91b admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:02.061161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8fda5-6d94-483c-a65f-58e77abfd91b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:54:02.061465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8fda5-6d94-483c-a65f-58e77abfd91b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:02.063838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8fda5-6d94-483c-a65f-58e77abfd91b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:02.079405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1195/2367] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:54:02.080589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef21b03-c3ca-4f0d-8a9e-8a89252aca68 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:02.090025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef21b03-c3ca-4f0d-8a9e-8a89252aca68 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:02.095257 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bcda3-a21f-43f2-b956-29697e99acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:02.096223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bcda3-a21f-43f2-b956-29697e99acf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:02.096656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bcda3-a21f-43f2-b956-29697e99acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:02.099493 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bcda3-a21f-43f2-b956-29697e99acf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:02.100511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bcda3-a21f-43f2-b956-29697e99acf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:02.102701 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bcda3-a21f-43f2-b956-29697e99acf9 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:02.137783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1173/2368] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:54:02 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:54:02.143482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8fda5-6d94-483c-a65f-58e77abfd91b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:02.161286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8fda5-6d94-483c-a65f-58e77abfd91b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:02.200488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bcda3-a21f-43f2-b956-29697e99acf9 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:02.202502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cb1bcda3-a21f-43f2-b956-29697e99acf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:02.253972 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672f54-9399-4cd8-85c0-2aba5d044d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:02.254823 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672f54-9399-4cd8-85c0-2aba5d044d0b admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:02.255178 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672f54-9399-4cd8-85c0-2aba5d044d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:02.255499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672f54-9399-4cd8-85c0-2aba5d044d0b admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:02.256318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9672f54-9399-4cd8-85c0-2aba5d044d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:02.259029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9672f54-9399-4cd8-85c0-2aba5d044d0b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:02.289176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bcda3-a21f-43f2-b956-29697e99acf9 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:02.293719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8875-36bc-40f3-9ca4-7c18c0f220c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:02.294714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8875-36bc-40f3-9ca4-7c18c0f220c9 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:02.295187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8875-36bc-40f3-9ca4-7c18c0f220c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:02.295615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8875-36bc-40f3-9ca4-7c18c0f220c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:02.297983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-22dd8875-36bc-40f3-9ca4-7c18c0f220c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:02.303006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1196/2369] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:54:02 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:54:02.307664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672f54-9399-4cd8-85c0-2aba5d044d0b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:02.319709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672f54-9399-4cd8-85c0-2aba5d044d0b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:02.326561 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3f40-0e4a-478b-8ade-3565c1e39c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:02.327246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3f40-0e4a-478b-8ade-3565c1e39c47 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:02.327878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3f40-0e4a-478b-8ade-3565c1e39c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:02.328151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3f40-0e4a-478b-8ade-3565c1e39c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:02.328947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a3f40-0e4a-478b-8ade-3565c1e39c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:02.331223 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a3f40-0e4a-478b-8ade-3565c1e39c47 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:02.354493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1197/2370] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:54:02.355913 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3f40-0e4a-478b-8ade-3565c1e39c47 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:02.371577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3f40-0e4a-478b-8ade-3565c1e39c47 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:02.379247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb4616-09a2-40fa-a3ae-65ef6c31ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:02.380016 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb4616-09a2-40fa-a3ae-65ef6c31ceec admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:02.380379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb4616-09a2-40fa-a3ae-65ef6c31ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:02.380723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb4616-09a2-40fa-a3ae-65ef6c31ceec admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:02.382482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb4616-09a2-40fa-a3ae-65ef6c31ceec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:02.384509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb4616-09a2-40fa-a3ae-65ef6c31ceec admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:02.400327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1198/2371] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:54:02.401494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb4616-09a2-40fa-a3ae-65ef6c31ceec admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:02.409272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd8875-36bc-40f3-9ca4-7c18c0f220c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:02.410788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd8875-36bc-40f3-9ca4-7c18c0f220c9 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:02.416221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb4616-09a2-40fa-a3ae-65ef6c31ceec admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:02.434274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1174/2372] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:54:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:54:02.446185 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e81f-1723-410b-9437-d27459a99d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:02.447595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e81f-1723-410b-9437-d27459a99d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:02.449874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e81f-1723-410b-9437-d27459a99d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:02.450338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e81f-1723-410b-9437-d27459a99d36 admin admin] PATH_INFO: `/v3/projects/f5919c7c8c5640909e1b61e1cd886421/users/cfa08e94c62b458ca5aa23a53d30f817/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:02.472247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91e81f-1723-410b-9437-d27459a99d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5919c7c8c5640909e1b61e1cd886421, user_id=cfa08e94c62b458ca5aa23a53d30f817, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:02.474998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91e81f-1723-410b-9437-d27459a99d36 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:02.496195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1199/2373] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:54:02 2022] PUT /identity/v3/projects/f5919c7c8c5640909e1b61e1cd886421/users/cfa08e94c62b458ca5aa23a53d30f817/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:54:02.501868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57f5e-bd9f-4a34-bfbd-bc66c11cbdbd None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:02.502510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57f5e-bd9f-4a34-bfbd-bc66c11cbdbd None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:02.502967 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57f5e-bd9f-4a34-bfbd-bc66c11cbdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:02.534741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-79b57f5e-bd9f-4a34-bfbd-bc66c11cbdbd None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:02.537556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-79b57f5e-bd9f-4a34-bfbd-bc66c11cbdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:02.633941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1175/2374] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:54:02.675326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e81f-1723-410b-9437-d27459a99d36 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:02.677871 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3a91e81f-1723-410b-9437-d27459a99d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:02.760623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e81f-1723-410b-9437-d27459a99d36 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:02.764457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f51f6-b508-48c3-927a-b7e67dd9b954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:02.765303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f51f6-b508-48c3-927a-b7e67dd9b954 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:02.765703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f51f6-b508-48c3-927a-b7e67dd9b954 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:02.766068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f51f6-b508-48c3-927a-b7e67dd9b954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:02.779049 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f51f6-b508-48c3-927a-b7e67dd9b954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:02.780715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f51f6-b508-48c3-927a-b7e67dd9b954 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:02.795752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1200/2375] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:54:08.267688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec156-897f-4ccb-ba58-fa9683b49061 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:08.268272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec156-897f-4ccb-ba58-fa9683b49061 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:08.268368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec156-897f-4ccb-ba58-fa9683b49061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:08.319088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-cecec156-897f-4ccb-ba58-fa9683b49061 None None] MFA Rules not processed for user `cfa08e94c62b458ca5aa23a53d30f817`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:08.325940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cecec156-897f-4ccb-ba58-fa9683b49061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:08.412813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1176/2376] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:54:08.427448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f51f6-b508-48c3-927a-b7e67dd9b954 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:08.428978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f58f51f6-b508-48c3-927a-b7e67dd9b954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:08.534198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f51f6-b508-48c3-927a-b7e67dd9b954 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:08.553645 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a97a39-25a5-4024-ad3b-d27381f860da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:08.554378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97a39-25a5-4024-ad3b-d27381f860da service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:08.554697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97a39-25a5-4024-ad3b-d27381f860da service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:08.555035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97a39-25a5-4024-ad3b-d27381f860da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:08.565344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a97a39-25a5-4024-ad3b-d27381f860da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:08.567696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a97a39-25a5-4024-ad3b-d27381f860da service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:08.596591 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1201/2377] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:54:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:54:10.533193 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b5b7-bc62-4069-85e8-54a7d479cfef None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:10.534064 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b5b7-bc62-4069-85e8-54a7d479cfef None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:10.534548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b5b7-bc62-4069-85e8-54a7d479cfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:10.553415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-2f83b5b7-bc62-4069-85e8-54a7d479cfef None None] MFA Rules not processed for user `cfa08e94c62b458ca5aa23a53d30f817`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:10.554730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2f83b5b7-bc62-4069-85e8-54a7d479cfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:10.567439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1177/2378] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:17.293703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57873c08-ca3d-4a36-8fab-3e2838189165 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:17.298595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57873c08-ca3d-4a36-8fab-3e2838189165 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:17.299546 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57873c08-ca3d-4a36-8fab-3e2838189165 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:17.302559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1202/2379] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:54:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:54:17.339170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23638982-54c5-4557-a3a6-c00ce3cf0311 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:17.339761 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23638982-54c5-4557-a3a6-c00ce3cf0311 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:17.339761 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23638982-54c5-4557-a3a6-c00ce3cf0311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:17.375991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-23638982-54c5-4557-a3a6-c00ce3cf0311 None None] MFA Rules not processed for user `4e04cc7f60894946aace79d4c2875f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:17.377986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-23638982-54c5-4557-a3a6-c00ce3cf0311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:17.525003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1178/2380] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:54:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:17.564029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57873c08-ca3d-4a36-8fab-3e2838189165 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:17.567328 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-57873c08-ca3d-4a36-8fab-3e2838189165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:17.593868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57873c08-ca3d-4a36-8fab-3e2838189165 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:17.604281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76131cba-8558-4f56-859a-6c8cc6bc5507 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:17.607173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131cba-8558-4f56-859a-6c8cc6bc5507 service placement] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:17.607825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131cba-8558-4f56-859a-6c8cc6bc5507 service placement] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:17.608389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131cba-8558-4f56-859a-6c8cc6bc5507 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:17.619185 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76131cba-8558-4f56-859a-6c8cc6bc5507 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:17.621340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76131cba-8558-4f56-859a-6c8cc6bc5507 service placement] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:17.639724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1203/2381] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:54:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:54:18.825942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23638982-54c5-4557-a3a6-c00ce3cf0311 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:18.827538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-23638982-54c5-4557-a3a6-c00ce3cf0311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:18.843368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23638982-54c5-4557-a3a6-c00ce3cf0311 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:18.849634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:18.850259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:18.850536 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:18.850802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] PATH_INFO: `/v3/users/d501be50ac5c4f53a1b70d7dd4e43472` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:18.856879 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d501be50ac5c4f53a1b70d7dd4e43472)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:18.859302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:18.917722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd501be50ac5c4f53a1b70d7dd4e43472'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:18.931242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd501be50ac5c4f53a1b70d7dd4e43472'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:18.932057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd501be50ac5c4f53a1b70d7dd4e43472'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:18.941977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd501be50ac5c4f53a1b70d7dd4e43472'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:18.943482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd501be50ac5c4f53a1b70d7dd4e43472'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:18.959569 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1179/2382] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:54:18 2022] DELETE /identity/v3/users/d501be50ac5c4f53a1b70d7dd4e43472 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:54:19.171912 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76131cba-8558-4f56-859a-6c8cc6bc5507 service placement] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:19.186740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76131cba-8558-4f56-859a-6c8cc6bc5507 service placement] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:19.283076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:19.283986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:19.284297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:19.284533 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] PATH_INFO: `/v3/projects/04a7af65767c49d2ae20e95b0fe39691` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:19.285756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a7af65767c49d2ae20e95b0fe39691)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:19.288134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:19.345108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a7af65767c49d2ae20e95b0fe39691', 'request_id': 'req-da549bd5-0888-487a-94de-532750beb64f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:19.355067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a7af65767c49d2ae20e95b0fe39691', 'request_id': 'req-da549bd5-0888-487a-94de-532750beb64f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:19.366252 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a7af65767c49d2ae20e95b0fe39691', 'request_id': 'req-da549bd5-0888-487a-94de-532750beb64f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:19.378532 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] The token cache is being invalidate because project 04a7af65767c49d2ae20e95b0fe39691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:54:19.378885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:19.379812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-da549bd5-0888-487a-94de-532750beb64f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:19.381660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1204/2383] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:54:19 2022] DELETE /identity/v3/projects/04a7af65767c49d2ae20e95b0fe39691 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:54:19.386007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:19.387717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:19.401074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251bea1-14fa-40d1-b62c-23606b64aa5c admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:19.466662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:19.467625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:19.467944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:19.468581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] PATH_INFO: `/v3/users/4f0a865658144936b26d16afe0a6139a` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:19.470009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0a865658144936b26d16afe0a6139a)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:19.472255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:19.546074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0a865658144936b26d16afe0a6139a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:19.564352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0a865658144936b26d16afe0a6139a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:19.565232 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0a865658144936b26d16afe0a6139a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:19.578988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0a865658144936b26d16afe0a6139a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:19.582770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0a865658144936b26d16afe0a6139a'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:19.605524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1180/2384] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:54:19 2022] DELETE /identity/v3/users/4f0a865658144936b26d16afe0a6139a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:54:19.848828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f4c10-fb98-4682-b7a2-6c7907501c91 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:19.849113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f4c10-fb98-4682-b7a2-6c7907501c91 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:19.849385 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f4c10-fb98-4682-b7a2-6c7907501c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:19.867407 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-647f4c10-fb98-4682-b7a2-6c7907501c91 None None] MFA Rules not processed for user `9b6aabdc3b9b4a588e14277fc9a52fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:19.868594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-647f4c10-fb98-4682-b7a2-6c7907501c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:19.923280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:19.924886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:19.930138 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1205/2385] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:20.006404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25210f8b-b70c-4c00-bfee-77c619fe0ac8 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:20.011324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:20.012357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.012698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.013036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] PATH_INFO: `/v3/projects/7f1a69d419ab40179710eac879a52392` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.014333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1a69d419ab40179710eac879a52392)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:20.016351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:20.066127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1a69d419ab40179710eac879a52392', 'request_id': 'req-fba34407-6a49-4324-8935-eef39467ead6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:20.072518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1a69d419ab40179710eac879a52392', 'request_id': 'req-fba34407-6a49-4324-8935-eef39467ead6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:20.082133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1a69d419ab40179710eac879a52392', 'request_id': 'req-fba34407-6a49-4324-8935-eef39467ead6'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:20.093093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] The token cache is being invalidate because project 7f1a69d419ab40179710eac879a52392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:54:20.093442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:20.094064 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-fba34407-6a49-4324-8935-eef39467ead6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:20.095649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1181/2386] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:54:19 2022] DELETE /identity/v3/projects/7f1a69d419ab40179710eac879a52392 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:54:20.100570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9744a9-eabc-4fa2-9ba4-bde6cac6dfbb None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.100852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9744a9-eabc-4fa2-9ba4-bde6cac6dfbb None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.101134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9744a9-eabc-4fa2-9ba4-bde6cac6dfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.120608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6d9744a9-eabc-4fa2-9ba4-bde6cac6dfbb None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:20.121743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6d9744a9-eabc-4fa2-9ba4-bde6cac6dfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:20.182944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1206/2387] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:20.191085 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ec65-ee1a-44f1-8f82-100b84c262e2 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.191331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ec65-ee1a-44f1-8f82-100b84c262e2 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.191605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ec65-ee1a-44f1-8f82-100b84c262e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.210924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-9d24ec65-ee1a-44f1-8f82-100b84c262e2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:20.212316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9d24ec65-ee1a-44f1-8f82-100b84c262e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:20.224115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1182/2388] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:20.225728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9744a9-eabc-4fa2-9ba4-bde6cac6dfbb None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:20.236259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9744a9-eabc-4fa2-9ba4-bde6cac6dfbb None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:20.241294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2307b8f-7d2c-4906-96df-d82a60d7c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:20.242356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2307b8f-7d2c-4906-96df-d82a60d7c1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.242356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2307b8f-7d2c-4906-96df-d82a60d7c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.243144 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2307b8f-7d2c-4906-96df-d82a60d7c1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.243608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2307b8f-7d2c-4906-96df-d82a60d7c1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:54:20.243916 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2307b8f-7d2c-4906-96df-d82a60d7c1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:20.246172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2307b8f-7d2c-4906-96df-d82a60d7c1d0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:20.265081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1207/2389] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:54:20.269147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ec65-ee1a-44f1-8f82-100b84c262e2 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:20.290107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ec65-ee1a-44f1-8f82-100b84c262e2 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:20.293652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42a851-b892-4791-8587-357cc1edec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:20.294433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42a851-b892-4791-8587-357cc1edec4a admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.294903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42a851-b892-4791-8587-357cc1edec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.295188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42a851-b892-4791-8587-357cc1edec4a admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.296079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42a851-b892-4791-8587-357cc1edec4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:20.298112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42a851-b892-4791-8587-357cc1edec4a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:20.338929 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1183/2390] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:54:20 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:54:20.342991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2307b8f-7d2c-4906-96df-d82a60d7c1d0 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:20.355173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2307b8f-7d2c-4906-96df-d82a60d7c1d0 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:20.425538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6868d3-f1e7-4152-9a07-571d92c58116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:20.426284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6868d3-f1e7-4152-9a07-571d92c58116 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.426567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6868d3-f1e7-4152-9a07-571d92c58116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.426846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6868d3-f1e7-4152-9a07-571d92c58116 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.427560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6868d3-f1e7-4152-9a07-571d92c58116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:20.429521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6868d3-f1e7-4152-9a07-571d92c58116 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:20.455286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1208/2391] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:54:20 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:54:20.459408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42a851-b892-4791-8587-357cc1edec4a admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:20.475244 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42a851-b892-4791-8587-357cc1edec4a admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:20.479939 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1fab6-91e5-40b7-a1a4-e9a99b4e29fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:20.480642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1fab6-91e5-40b7-a1a4-e9a99b4e29fd admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.480917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1fab6-91e5-40b7-a1a4-e9a99b4e29fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.481208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1fab6-91e5-40b7-a1a4-e9a99b4e29fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.485854 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1fab6-91e5-40b7-a1a4-e9a99b4e29fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:20.487801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1fab6-91e5-40b7-a1a4-e9a99b4e29fd admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:20.503584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1184/2392] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:54:20.505287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6868d3-f1e7-4152-9a07-571d92c58116 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:20.521991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6868d3-f1e7-4152-9a07-571d92c58116 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:20.527090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1a15-2cc7-4feb-92db-dc1246f98300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:20.527858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1a15-2cc7-4feb-92db-dc1246f98300 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.528291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1a15-2cc7-4feb-92db-dc1246f98300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.528633 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1a15-2cc7-4feb-92db-dc1246f98300 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.529450 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1a15-2cc7-4feb-92db-dc1246f98300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:20.531376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1a15-2cc7-4feb-92db-dc1246f98300 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:20.546580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1209/2393] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:54:20.547928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1fab6-91e5-40b7-a1a4-e9a99b4e29fd admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:20.565048 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1fab6-91e5-40b7-a1a4-e9a99b4e29fd admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:20.571476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20ef8-e659-4370-a6c0-01ba74605b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:20.571985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20ef8-e659-4370-a6c0-01ba74605b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.572265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20ef8-e659-4370-a6c0-01ba74605b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.572540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20ef8-e659-4370-a6c0-01ba74605b17 admin admin] PATH_INFO: `/v3/projects/80beba083ff5448781d8ab4284ee268e/users/d2826edd5c584d4cbb839118063b490f/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.594338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef20ef8-e659-4370-a6c0-01ba74605b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80beba083ff5448781d8ab4284ee268e, user_id=d2826edd5c584d4cbb839118063b490f, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:20.594338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef20ef8-e659-4370-a6c0-01ba74605b17 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:20.613621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1185/2394] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:54:20 2022] PUT /identity/v3/projects/80beba083ff5448781d8ab4284ee268e/users/d2826edd5c584d4cbb839118063b490f/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:54:20.622995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3cec9-3b7e-4b82-a19a-fd8217049804 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.623283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3cec9-3b7e-4b82-a19a-fd8217049804 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.623569 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3cec9-3b7e-4b82-a19a-fd8217049804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.675554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-63c3cec9-3b7e-4b82-a19a-fd8217049804 None None] MFA Rules not processed for user `d2826edd5c584d4cbb839118063b490f`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:20.675554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-63c3cec9-3b7e-4b82-a19a-fd8217049804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:20.756109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1210/2395] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:20.768457 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20ef8-e659-4370-a6c0-01ba74605b17 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:20.770187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cef20ef8-e659-4370-a6c0-01ba74605b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:20.861338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20ef8-e659-4370-a6c0-01ba74605b17 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:20.869197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c834437-d315-4643-a1f3-9fe6687ff6f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f94515985e244af29f47a49c0dd415ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:20.869975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c834437-d315-4643-a1f3-9fe6687ff6f5 service glance] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:20.870294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c834437-d315-4643-a1f3-9fe6687ff6f5 service glance] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:20.870562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c834437-d315-4643-a1f3-9fe6687ff6f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:20.881480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c834437-d315-4643-a1f3-9fe6687ff6f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:20.883033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c834437-d315-4643-a1f3-9fe6687ff6f5 service glance] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:20.893270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1186/2396] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:54:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:54:25.883217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb51a-2d3b-413f-955d-463cf3c3e34a None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:25.883761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb51a-2d3b-413f-955d-463cf3c3e34a None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:25.883761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb51a-2d3b-413f-955d-463cf3c3e34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:25.901434 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-71abb51a-2d3b-413f-955d-463cf3c3e34a None None] MFA Rules not processed for user `6c853d04dd5147f5961bf551b608da33`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:25.902678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-71abb51a-2d3b-413f-955d-463cf3c3e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:25.959635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1211/2397] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:29.523841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c834437-d315-4643-a1f3-9fe6687ff6f5 service glance] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:29.525323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5c834437-d315-4643-a1f3-9fe6687ff6f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:29.584245 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c834437-d315-4643-a1f3-9fe6687ff6f5 service glance] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:29.587969 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb50026-b86f-419d-a934-196ed42006c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:29.588636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50026-b86f-419d-a934-196ed42006c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:29.588918 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50026-b86f-419d-a934-196ed42006c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:29.589221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50026-b86f-419d-a934-196ed42006c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:29.591047 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-feb50026-b86f-419d-a934-196ed42006c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:29.662193 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb50026-b86f-419d-a934-196ed42006c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:29.663853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb50026-b86f-419d-a934-196ed42006c0 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:29.673479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1187/2398] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:54:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:54:44.389195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68214e46-1c45-496b-9364-e92c0c7843a7 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:44.390275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68214e46-1c45-496b-9364-e92c0c7843a7 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:44.390649 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68214e46-1c45-496b-9364-e92c0c7843a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:44.412222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-68214e46-1c45-496b-9364-e92c0c7843a7 None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:44.413545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-68214e46-1c45-496b-9364-e92c0c7843a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:44.467248 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1212/2399] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:54:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:44.510830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb50026-b86f-419d-a934-196ed42006c0 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:44.512285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-feb50026-b86f-419d-a934-196ed42006c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:44.580516 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb50026-b86f-419d-a934-196ed42006c0 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:44.585503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1301c-a984-41d4-9dea-723a004298a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:44.586190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1301c-a984-41d4-9dea-723a004298a7 service swift] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:44.586464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1301c-a984-41d4-9dea-723a004298a7 service swift] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:44.586756 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1301c-a984-41d4-9dea-723a004298a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:44.595104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1301c-a984-41d4-9dea-723a004298a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:44.596319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1301c-a984-41d4-9dea-723a004298a7 service swift] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:44.606673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1188/2400] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:54:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:54:50.651976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68214e46-1c45-496b-9364-e92c0c7843a7 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:50.772660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68214e46-1c45-496b-9364-e92c0c7843a7 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:50.779530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:50.780854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:50.781140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:50.781424 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] PATH_INFO: `/v3/users/d2826edd5c584d4cbb839118063b490f` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:50.782921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2826edd5c584d4cbb839118063b490f)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:50.784945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:50.878322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2826edd5c584d4cbb839118063b490f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:50.896045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2826edd5c584d4cbb839118063b490f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:50.906747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2826edd5c584d4cbb839118063b490f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:50.907470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2826edd5c584d4cbb839118063b490f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:50.918393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2826edd5c584d4cbb839118063b490f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:50.936597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1213/2401] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:54:50 2022] DELETE /identity/v3/users/d2826edd5c584d4cbb839118063b490f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:54:50.941243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b88ba8-ede5-4699-bd84-19532235c98b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:50.941770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b88ba8-ede5-4699-bd84-19532235c98b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:50.941971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b88ba8-ede5-4699-bd84-19532235c98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:51.014144 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-16b88ba8-ede5-4699-bd84-19532235c98b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:51.015448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-16b88ba8-ede5-4699-bd84-19532235c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:51.084177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1189/2402] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:51.109698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:51.111402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:51.245464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22275e6b-320f-4616-b4c8-503763f17397 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:51.250340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0634e-68a8-45dc-9eda-1fd9de59f3a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:51.251727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0634e-68a8-45dc-9eda-1fd9de59f3a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:51.252174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0634e-68a8-45dc-9eda-1fd9de59f3a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:51.252605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0634e-68a8-45dc-9eda-1fd9de59f3a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:51.266418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0634e-68a8-45dc-9eda-1fd9de59f3a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:51.268143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0634e-68a8-45dc-9eda-1fd9de59f3a9 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:51.298579 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1214/2403] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:54:51.655422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b88ba8-ede5-4699-bd84-19532235c98b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:51.656993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-16b88ba8-ede5-4699-bd84-19532235c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:51.674949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b88ba8-ede5-4699-bd84-19532235c98b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:51.679900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:51.681060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:51.681481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:51.681889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] PATH_INFO: `/v3/projects/80beba083ff5448781d8ab4284ee268e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:51.683289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=80beba083ff5448781d8ab4284ee268e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:51.686279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:51.752426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80beba083ff5448781d8ab4284ee268e', 'request_id': 'req-3da8dd33-9869-4d87-bb61-6eac908b2afd'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:51.759787 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80beba083ff5448781d8ab4284ee268e', 'request_id': 'req-3da8dd33-9869-4d87-bb61-6eac908b2afd'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:51.771197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80beba083ff5448781d8ab4284ee268e', 'request_id': 'req-3da8dd33-9869-4d87-bb61-6eac908b2afd'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:51.784673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] The token cache is being invalidate because project 80beba083ff5448781d8ab4284ee268e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:54:51.784954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:51.785603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-3da8dd33-9869-4d87-bb61-6eac908b2afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:54:51.792847 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1190/2404] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:54:51 2022] DELETE /identity/v3/projects/80beba083ff5448781d8ab4284ee268e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:54:51.794517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b906f8-3ff4-40a5-9d9e-8e42a4874973 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:51.795019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b906f8-3ff4-40a5-9d9e-8e42a4874973 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:51.795179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b906f8-3ff4-40a5-9d9e-8e42a4874973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:51.849191 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b2b906f8-3ff4-40a5-9d9e-8e42a4874973 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:51.850983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b2b906f8-3ff4-40a5-9d9e-8e42a4874973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:51.944534 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1215/2405] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:51.954365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948237-0846-417e-ac58-ec3899a5ae74 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:51.956166 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948237-0846-417e-ac58-ec3899a5ae74 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:51.956598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948237-0846-417e-ac58-ec3899a5ae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:51.994385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-28948237-0846-417e-ac58-ec3899a5ae74 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:51.996324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-28948237-0846-417e-ac58-ec3899a5ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:52.008460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1191/2406] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:54:52.013460 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b906f8-3ff4-40a5-9d9e-8e42a4874973 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:52.028372 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b906f8-3ff4-40a5-9d9e-8e42a4874973 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:52.039419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2883749-2bd8-40fc-b774-d7e3b14ffb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:52.041294 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2883749-2bd8-40fc-b774-d7e3b14ffb31 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:52.041864 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2883749-2bd8-40fc-b774-d7e3b14ffb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:52.042485 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2883749-2bd8-40fc-b774-d7e3b14ffb31 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:52.043562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2883749-2bd8-40fc-b774-d7e3b14ffb31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:54:52.044041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2883749-2bd8-40fc-b774-d7e3b14ffb31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:52.046523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2883749-2bd8-40fc-b774-d7e3b14ffb31 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:52.064611 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1216/2407] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:54:52.069903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948237-0846-417e-ac58-ec3899a5ae74 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:52.080080 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948237-0846-417e-ac58-ec3899a5ae74 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:52.088730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbfa30-5a36-4e25-b48c-073e9fd4b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:52.089458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbfa30-5a36-4e25-b48c-073e9fd4b7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:52.090037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbfa30-5a36-4e25-b48c-073e9fd4b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:52.090422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbfa30-5a36-4e25-b48c-073e9fd4b7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:52.091201 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbfa30-5a36-4e25-b48c-073e9fd4b7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:52.093299 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbfa30-5a36-4e25-b48c-073e9fd4b7d0 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:52.122745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1192/2408] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:54:52 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:54:52.126908 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2883749-2bd8-40fc-b774-d7e3b14ffb31 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:52.138062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2883749-2bd8-40fc-b774-d7e3b14ffb31 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:52.210623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9519fad-43a8-48e3-ab28-83a2f2f1fed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:52.211521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9519fad-43a8-48e3-ab28-83a2f2f1fed9 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:52.212043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9519fad-43a8-48e3-ab28-83a2f2f1fed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:52.212381 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9519fad-43a8-48e3-ab28-83a2f2f1fed9 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:52.215555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9519fad-43a8-48e3-ab28-83a2f2f1fed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:52.215555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9519fad-43a8-48e3-ab28-83a2f2f1fed9 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:52.242132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1217/2409] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:54:52 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:54:52.243453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbfa30-5a36-4e25-b48c-073e9fd4b7d0 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:52.254857 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbfa30-5a36-4e25-b48c-073e9fd4b7d0 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:52.259874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b034bb-380e-45c9-8922-cdce8f8106b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:52.260656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b034bb-380e-45c9-8922-cdce8f8106b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:52.261207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b034bb-380e-45c9-8922-cdce8f8106b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:52.261514 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b034bb-380e-45c9-8922-cdce8f8106b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:52.262294 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b034bb-380e-45c9-8922-cdce8f8106b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:52.264183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b034bb-380e-45c9-8922-cdce8f8106b3 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:52.283470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1193/2410] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:54:52.289128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9519fad-43a8-48e3-ab28-83a2f2f1fed9 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:52.301493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9519fad-43a8-48e3-ab28-83a2f2f1fed9 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:52.306842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c5b5-580c-4c59-80b0-2b6e4def50da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:52.307513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c5b5-580c-4c59-80b0-2b6e4def50da admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:52.307797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c5b5-580c-4c59-80b0-2b6e4def50da admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:52.308066 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c5b5-580c-4c59-80b0-2b6e4def50da admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:52.308992 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c5b5-580c-4c59-80b0-2b6e4def50da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:52.311062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c5b5-580c-4c59-80b0-2b6e4def50da admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:52.327553 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1218/2411] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:54:52.330571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b034bb-380e-45c9-8922-cdce8f8106b3 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:52.341186 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b034bb-380e-45c9-8922-cdce8f8106b3 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:52.346593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55d1b6-cd40-4501-9dfc-5830c336babd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:52.347788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55d1b6-cd40-4501-9dfc-5830c336babd admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:52.348276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55d1b6-cd40-4501-9dfc-5830c336babd admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:52.348773 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55d1b6-cd40-4501-9dfc-5830c336babd admin admin] PATH_INFO: `/v3/projects/3d0d20df305342d4b51d837233d4063f/users/3b3b7b554caf4c98a85276a1802cd0ee/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:52.365408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55d1b6-cd40-4501-9dfc-5830c336babd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0d20df305342d4b51d837233d4063f, user_id=3b3b7b554caf4c98a85276a1802cd0ee, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:52.368252 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55d1b6-cd40-4501-9dfc-5830c336babd admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:52.384591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1194/2412] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:54:52 2022] PUT /identity/v3/projects/3d0d20df305342d4b51d837233d4063f/users/3b3b7b554caf4c98a85276a1802cd0ee/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:54:52.396076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77418654-d4f7-4924-819f-09f17ca54838 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:52.396420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77418654-d4f7-4924-819f-09f17ca54838 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:52.396623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77418654-d4f7-4924-819f-09f17ca54838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:52.426660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-77418654-d4f7-4924-819f-09f17ca54838 None None] MFA Rules not processed for user `3b3b7b554caf4c98a85276a1802cd0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:52.427836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-77418654-d4f7-4924-819f-09f17ca54838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:52.498434 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1219/2413] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:54:52.505969 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55d1b6-cd40-4501-9dfc-5830c336babd admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:54:52.507912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0d55d1b6-cd40-4501-9dfc-5830c336babd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:52.571707 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55d1b6-cd40-4501-9dfc-5830c336babd admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:54:52.575619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576020f-c6a1-40f1-83ad-f6a296dd5fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:54:52.576379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576020f-c6a1-40f1-83ad-f6a296dd5fea service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:52.576649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576020f-c6a1-40f1-83ad-f6a296dd5fea service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:52.577033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576020f-c6a1-40f1-83ad-f6a296dd5fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:52.588904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576020f-c6a1-40f1-83ad-f6a296dd5fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:54:52.590382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576020f-c6a1-40f1-83ad-f6a296dd5fea service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:54:52.599905 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1195/2414] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:54:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:54:59.304811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab5594-3522-4ff8-b943-92023afa6585 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:54:59.305368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab5594-3522-4ff8-b943-92023afa6585 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:54:59.305368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab5594-3522-4ff8-b943-92023afa6585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:54:59.324843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-56ab5594-3522-4ff8-b943-92023afa6585 None None] MFA Rules not processed for user `3b3b7b554caf4c98a85276a1802cd0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:54:59.325935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-56ab5594-3522-4ff8-b943-92023afa6585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:54:59.333626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1220/2415] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:54:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:03.455028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a82c3-8b02-4974-9873-7d624be53e4a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:03.455575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a82c3-8b02-4974-9873-7d624be53e4a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:03.455837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a82c3-8b02-4974-9873-7d624be53e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:03.477916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f62a82c3-8b02-4974-9873-7d624be53e4a None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:03.480005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f62a82c3-8b02-4974-9873-7d624be53e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:03.541894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1196/2416] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:55:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:03.555404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab5594-3522-4ff8-b943-92023afa6585 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:03.556847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-56ab5594-3522-4ff8-b943-92023afa6585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:03.640135 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab5594-3522-4ff8-b943-92023afa6585 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:03.649573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4ae6c-7c67-4f58-8be1-f5d6c40ec4ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:03.650507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ae6c-7c67-4f58-8be1-f5d6c40ec4ea service swift] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:03.650918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ae6c-7c67-4f58-8be1-f5d6c40ec4ea service swift] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:03.651352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ae6c-7c67-4f58-8be1-f5d6c40ec4ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:03.666609 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4ae6c-7c67-4f58-8be1-f5d6c40ec4ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:03.668390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4ae6c-7c67-4f58-8be1-f5d6c40ec4ea service swift] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:03.676644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1221/2417] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:55:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:06.145856 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b970c-05b0-44a4-ac3b-33c62ed7dcb4 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:06.146390 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b970c-05b0-44a4-ac3b-33c62ed7dcb4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:06.154319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b970c-05b0-44a4-ac3b-33c62ed7dcb4 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:06.156527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1197/2418] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:55:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:06.168679 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9fd70-ed17-4fd7-a0bf-2b6dd8339cc6 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:06.169181 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9fd70-ed17-4fd7-a0bf-2b6dd8339cc6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:06.170845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9fd70-ed17-4fd7-a0bf-2b6dd8339cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:06.196994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-97f9fd70-ed17-4fd7-a0bf-2b6dd8339cc6 None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:06.198520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-97f9fd70-ed17-4fd7-a0bf-2b6dd8339cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:06.281700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1222/2419] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:55:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:06.294859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b970c-05b0-44a4-ac3b-33c62ed7dcb4 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:06.296598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d54b970c-05b0-44a4-ac3b-33c62ed7dcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:06.391584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b970c-05b0-44a4-ac3b-33c62ed7dcb4 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:06.391584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5ae6-1b34-49f5-8107-7f0cf0b52f62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f94515985e244af29f47a49c0dd415ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:06.393529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5ae6-1b34-49f5-8107-7f0cf0b52f62 service glance] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:06.393745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5ae6-1b34-49f5-8107-7f0cf0b52f62 service glance] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:06.394011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5ae6-1b34-49f5-8107-7f0cf0b52f62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:06.406695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5ae6-1b34-49f5-8107-7f0cf0b52f62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:06.408255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5ae6-1b34-49f5-8107-7f0cf0b52f62 service glance] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:06.441967 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1198/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:06.564726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe261a-268e-49d3-af2d-a31e190c4482 None None] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:06.565107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe261a-268e-49d3-af2d-a31e190c4482 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:06.565471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe261a-268e-49d3-af2d-a31e190c4482 None None] PATH_INFO: `/` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:06.567644 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1223/2421] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:06.573441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2334-8947-4ec8-96b3-83e05456152e None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:06.574320 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2334-8947-4ec8-96b3-83e05456152e None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:06.575119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a2334-8947-4ec8-96b3-83e05456152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:06.613234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-6f8a2334-8947-4ec8-96b3-83e05456152e None None] MFA Rules not processed for user `444a88451fbd4814b6d81023e68b54a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:06.615142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6f8a2334-8947-4ec8-96b3-83e05456152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:06.703858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1199/2422] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:55:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:55:06.717034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe261a-268e-49d3-af2d-a31e190c4482 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:06.718962 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c8fe261a-268e-49d3-af2d-a31e190c4482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:06.745214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe261a-268e-49d3-af2d-a31e190c4482 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:06.750603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4832c-614e-4e66-8c94-51efc8e0c1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:06.752062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4832c-614e-4e66-8c94-51efc8e0c1bd service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:06.752062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4832c-614e-4e66-8c94-51efc8e0c1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:06.752424 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4832c-614e-4e66-8c94-51efc8e0c1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:06.765590 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4832c-614e-4e66-8c94-51efc8e0c1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:06.765809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4832c-614e-4e66-8c94-51efc8e0c1bd service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:06.775488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1224/2423] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:06.924087 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167796b-8fcc-4d99-84d0-ff28ef37f012 None None] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:06.924487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167796b-8fcc-4d99-84d0-ff28ef37f012 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:06.924690 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167796b-8fcc-4d99-84d0-ff28ef37f012 None None] PATH_INFO: `/` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:06.926700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1200/2424] 10.222.0.20 () {54 vars in 921 bytes} [Fri Oct 28 19:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:06.932529 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35e826-9bc9-4724-b459-b753a24c041d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:06.933205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35e826-9bc9-4724-b459-b753a24c041d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:06.933695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35e826-9bc9-4724-b459-b753a24c041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:06.960387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-3f35e826-9bc9-4724-b459-b753a24c041d None None] MFA Rules not processed for user `be7be85d70b64273b7904082ee2ba848`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:06.962403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3f35e826-9bc9-4724-b459-b753a24c041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:06.976858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1225/2425] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Oct 28 19:55:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:06.985410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167796b-8fcc-4d99-84d0-ff28ef37f012 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:06.987405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4167796b-8fcc-4d99-84d0-ff28ef37f012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:07.018503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167796b-8fcc-4d99-84d0-ff28ef37f012 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:07.022370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab919d-d225-470a-a112-a5460614d1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:07.023231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab919d-d225-470a-a112-a5460614d1fc service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:07.023534 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab919d-d225-470a-a112-a5460614d1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:07.023965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab919d-d225-470a-a112-a5460614d1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:07.041718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab919d-d225-470a-a112-a5460614d1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:07.043472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab919d-d225-470a-a112-a5460614d1fc service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:07.055523 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1201/2426] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:10.344696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb52b13-bdb0-4926-b432-9609458100d4 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:10.345270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb52b13-bdb0-4926-b432-9609458100d4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:10.345270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb52b13-bdb0-4926-b432-9609458100d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:10.376282 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-aeb52b13-bdb0-4926-b432-9609458100d4 None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:10.377942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-aeb52b13-bdb0-4926-b432-9609458100d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:10.386126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1226/2427] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:55:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:10.400561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab919d-d225-470a-a112-a5460614d1fc service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:10.420897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab919d-d225-470a-a112-a5460614d1fc service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:10.432931 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a331e3-b9a3-4bf2-898b-7756915531f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:10.437009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a331e3-b9a3-4bf2-898b-7756915531f1 service swift] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:10.437820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a331e3-b9a3-4bf2-898b-7756915531f1 service swift] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:10.439021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a331e3-b9a3-4bf2-898b-7756915531f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:10.457975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a331e3-b9a3-4bf2-898b-7756915531f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:10.461502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a331e3-b9a3-4bf2-898b-7756915531f1 service swift] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:10.477340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1202/2428] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:55:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:22.201305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f4cc3-5bb1-4a38-bb4f-a8276dddbacc None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:22.201891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f4cc3-5bb1-4a38-bb4f-a8276dddbacc None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:22.201891 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f4cc3-5bb1-4a38-bb4f-a8276dddbacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:22.220962 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-535f4cc3-5bb1-4a38-bb4f-a8276dddbacc None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:22.222293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-535f4cc3-5bb1-4a38-bb4f-a8276dddbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:22.236898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1227/2429] 10.222.0.20 () {58 vars in 967 bytes} [Fri Oct 28 19:55:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:22.251014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a331e3-b9a3-4bf2-898b-7756915531f1 service swift] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:22.261750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a331e3-b9a3-4bf2-898b-7756915531f1 service swift] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:22.267950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f187-1b95-480b-a91a-e3af262689ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:22.268679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f187-1b95-480b-a91a-e3af262689ce service swift] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:22.268978 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f187-1b95-480b-a91a-e3af262689ce service swift] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:22.269253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f187-1b95-480b-a91a-e3af262689ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:22.278218 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815f187-1b95-480b-a91a-e3af262689ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:22.279780 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815f187-1b95-480b-a91a-e3af262689ce service swift] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:22.288618 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1203/2430] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:55:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:23.488780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f4cc3-5bb1-4a38-bb4f-a8276dddbacc None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:23.490403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-535f4cc3-5bb1-4a38-bb4f-a8276dddbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:23.584854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f4cc3-5bb1-4a38-bb4f-a8276dddbacc None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:23.591833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b964df-ff00-43f5-9faf-00947fd58fb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:23.592496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b964df-ff00-43f5-9faf-00947fd58fb6 service placement] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:23.592779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b964df-ff00-43f5-9faf-00947fd58fb6 service placement] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:23.593042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b964df-ff00-43f5-9faf-00947fd58fb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:23.595113 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-84b964df-ff00-43f5-9faf-00947fd58fb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:23.606646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b964df-ff00-43f5-9faf-00947fd58fb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:23.608257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b964df-ff00-43f5-9faf-00947fd58fb6 service placement] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:23.618334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1228/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:24.270046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f187-1b95-480b-a91a-e3af262689ce service swift] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:24.271515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8815f187-1b95-480b-a91a-e3af262689ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:24.366888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f187-1b95-480b-a91a-e3af262689ce service swift] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:24.371495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:24.372380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:24.372660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:24.372933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] PATH_INFO: `/v3/users/9b6aabdc3b9b4a588e14277fc9a52fa0` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:24.374148 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6aabdc3b9b4a588e14277fc9a52fa0)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:24.376081 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:24.423586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6aabdc3b9b4a588e14277fc9a52fa0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:24.435494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6aabdc3b9b4a588e14277fc9a52fa0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:24.436104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6aabdc3b9b4a588e14277fc9a52fa0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:24.445387 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6aabdc3b9b4a588e14277fc9a52fa0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:24.445986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-335696c8-64ac-46f7-9466-85e23911aa08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6aabdc3b9b4a588e14277fc9a52fa0'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:24.458585 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1204/2432] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:55:24 2022] DELETE /identity/v3/users/9b6aabdc3b9b4a588e14277fc9a52fa0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:55:24.666585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b964df-ff00-43f5-9faf-00947fd58fb6 service placement] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:24.679119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b964df-ff00-43f5-9faf-00947fd58fb6 service placement] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:24.734351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:24.735258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:24.735570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:24.735961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] PATH_INFO: `/v3/projects/3b0d6bdc5136421792ba72516aa75ba2` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:24.737266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0d6bdc5136421792ba72516aa75ba2)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:24.739271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:24.788304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0d6bdc5136421792ba72516aa75ba2', 'request_id': 'req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:24.794542 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0d6bdc5136421792ba72516aa75ba2', 'request_id': 'req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:24.803435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0d6bdc5136421792ba72516aa75ba2', 'request_id': 'req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:24.815594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] The token cache is being invalidate because project 3b0d6bdc5136421792ba72516aa75ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:55:24.815929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:24.816587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4eafc8dc-4b57-4c1c-9df7-44f2f6279f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:24.818948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1229/2433] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:55:24 2022] DELETE /identity/v3/projects/3b0d6bdc5136421792ba72516aa75ba2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:55:24.824582 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52e420-c1ae-479a-a5c5-0fa9a3e0cc62 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:24.824845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52e420-c1ae-479a-a5c5-0fa9a3e0cc62 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:24.825129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52e420-c1ae-479a-a5c5-0fa9a3e0cc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:24.878237 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-bc52e420-c1ae-479a-a5c5-0fa9a3e0cc62 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:24.879467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bc52e420-c1ae-479a-a5c5-0fa9a3e0cc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:24.945128 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1205/2434] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:24.953165 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac3234-cb99-4edf-bc83-9bfd88f0dd42 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:24.953449 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac3234-cb99-4edf-bc83-9bfd88f0dd42 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:24.953727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac3234-cb99-4edf-bc83-9bfd88f0dd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:24.972614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-9eac3234-cb99-4edf-bc83-9bfd88f0dd42 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:24.973866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9eac3234-cb99-4edf-bc83-9bfd88f0dd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:24.983789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1230/2435] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:24.988029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52e420-c1ae-479a-a5c5-0fa9a3e0cc62 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:24.997925 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52e420-c1ae-479a-a5c5-0fa9a3e0cc62 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:25.002589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eae9d-fabe-4bfa-a8d7-82e15698a62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:25.003266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eae9d-fabe-4bfa-a8d7-82e15698a62e admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.003552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eae9d-fabe-4bfa-a8d7-82e15698a62e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.003829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eae9d-fabe-4bfa-a8d7-82e15698a62e admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.004574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3eae9d-fabe-4bfa-a8d7-82e15698a62e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:55:25.004881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3eae9d-fabe-4bfa-a8d7-82e15698a62e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:25.006581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3eae9d-fabe-4bfa-a8d7-82e15698a62e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:25.019427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1206/2436] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:55:25.023938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac3234-cb99-4edf-bc83-9bfd88f0dd42 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:25.033731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac3234-cb99-4edf-bc83-9bfd88f0dd42 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:25.039793 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4e3ec-1df4-489d-8bfa-cfd4cb87c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:25.040471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4e3ec-1df4-489d-8bfa-cfd4cb87c838 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.040752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4e3ec-1df4-489d-8bfa-cfd4cb87c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.040997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4e3ec-1df4-489d-8bfa-cfd4cb87c838 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.041699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4e3ec-1df4-489d-8bfa-cfd4cb87c838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:25.043815 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4e3ec-1df4-489d-8bfa-cfd4cb87c838 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:25.073537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1231/2437] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:55:25 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:55:25.077686 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eae9d-fabe-4bfa-a8d7-82e15698a62e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:25.088345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eae9d-fabe-4bfa-a8d7-82e15698a62e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:25.148483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0db7f-aab4-4f37-85b9-5a67a12d0008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:25.149490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0db7f-aab4-4f37-85b9-5a67a12d0008 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.149771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0db7f-aab4-4f37-85b9-5a67a12d0008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.150045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0db7f-aab4-4f37-85b9-5a67a12d0008 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.150769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0db7f-aab4-4f37-85b9-5a67a12d0008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:25.152738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0db7f-aab4-4f37-85b9-5a67a12d0008 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:25.177560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1207/2438] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:55:25 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:55:25.178958 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4e3ec-1df4-489d-8bfa-cfd4cb87c838 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:25.191289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4e3ec-1df4-489d-8bfa-cfd4cb87c838 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:25.197061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ad9c-1e1c-494f-89f1-f507ec5ec415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:25.198004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ad9c-1e1c-494f-89f1-f507ec5ec415 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.198409 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ad9c-1e1c-494f-89f1-f507ec5ec415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.198744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ad9c-1e1c-494f-89f1-f507ec5ec415 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.199692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4ad9c-1e1c-494f-89f1-f507ec5ec415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:25.201479 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4ad9c-1e1c-494f-89f1-f507ec5ec415 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:25.212637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1232/2439] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:55:25.216815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0db7f-aab4-4f37-85b9-5a67a12d0008 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:25.227045 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0db7f-aab4-4f37-85b9-5a67a12d0008 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:25.232103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2f801-91fb-433a-873a-9e5179eae091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:25.232775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2f801-91fb-433a-873a-9e5179eae091 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.233053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2f801-91fb-433a-873a-9e5179eae091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.233328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2f801-91fb-433a-873a-9e5179eae091 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.234053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2f801-91fb-433a-873a-9e5179eae091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:25.235688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2f801-91fb-433a-873a-9e5179eae091 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:25.246096 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1208/2440] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:55:25.250191 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ad9c-1e1c-494f-89f1-f507ec5ec415 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:25.260337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ad9c-1e1c-494f-89f1-f507ec5ec415 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:25.265288 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf5428-45a8-4639-a982-61f3068f9d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:25.266199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf5428-45a8-4639-a982-61f3068f9d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.266487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf5428-45a8-4639-a982-61f3068f9d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.266767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf5428-45a8-4639-a982-61f3068f9d56 admin admin] PATH_INFO: `/v3/projects/6b077e6b908a44a081157227322ff9df/users/dad796159ca142a7a5bc38c92ef91530/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.281940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf5428-45a8-4639-a982-61f3068f9d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b077e6b908a44a081157227322ff9df, user_id=dad796159ca142a7a5bc38c92ef91530, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:25.284629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf5428-45a8-4639-a982-61f3068f9d56 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:25.298655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1233/2441] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:55:25 2022] PUT /identity/v3/projects/6b077e6b908a44a081157227322ff9df/users/dad796159ca142a7a5bc38c92ef91530/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:55:25.309285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013711e-ddb7-42e9-8b97-90fc186bcda4 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.309753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013711e-ddb7-42e9-8b97-90fc186bcda4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.309963 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013711e-ddb7-42e9-8b97-90fc186bcda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.340067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-6013711e-ddb7-42e9-8b97-90fc186bcda4 None None] MFA Rules not processed for user `dad796159ca142a7a5bc38c92ef91530`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:25.341280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6013711e-ddb7-42e9-8b97-90fc186bcda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:25.410950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1209/2442] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:25.423964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf5428-45a8-4639-a982-61f3068f9d56 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:25.425768 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-12bf5428-45a8-4639-a982-61f3068f9d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:25.486471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf5428-45a8-4639-a982-61f3068f9d56 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:25.490390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c8276-ea7c-4f47-ba2b-3c45c0341092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:25.491061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8276-ea7c-4f47-ba2b-3c45c0341092 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.491977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8276-ea7c-4f47-ba2b-3c45c0341092 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.492418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8276-ea7c-4f47-ba2b-3c45c0341092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.501364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c8276-ea7c-4f47-ba2b-3c45c0341092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:25.502883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c8276-ea7c-4f47-ba2b-3c45c0341092 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:25.514005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1234/2443] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:55:31.378189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842ba1e-7f9d-40d4-8367-63da211e19f3 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:31.379111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842ba1e-7f9d-40d4-8367-63da211e19f3 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:31.379394 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842ba1e-7f9d-40d4-8367-63da211e19f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:31.403542 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-8842ba1e-7f9d-40d4-8367-63da211e19f3 None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:31.405454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8842ba1e-7f9d-40d4-8367-63da211e19f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:31.466338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1210/2444] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:55:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:55:31.479005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c8276-ea7c-4f47-ba2b-3c45c0341092 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:31.481726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-285c8276-ea7c-4f47-ba2b-3c45c0341092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:31.553253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c8276-ea7c-4f47-ba2b-3c45c0341092 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:31.559027 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497f9d3-1a0b-4306-84b0-38198a9ba054 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:31.559681 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497f9d3-1a0b-4306-84b0-38198a9ba054 service swift] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:31.559964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497f9d3-1a0b-4306-84b0-38198a9ba054 service swift] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:31.560233 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497f9d3-1a0b-4306-84b0-38198a9ba054 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:31.568170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497f9d3-1a0b-4306-84b0-38198a9ba054 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:31.569772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497f9d3-1a0b-4306-84b0-38198a9ba054 service swift] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:31.577562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1235/2445] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:55:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 19:55:32.090364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd40132-6346-4939-9959-f9a5cd642108 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:32.090645 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd40132-6346-4939-9959-f9a5cd642108 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:32.090916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd40132-6346-4939-9959-f9a5cd642108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:32.108831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1bd40132-6346-4939-9959-f9a5cd642108 None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:32.109998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1bd40132-6346-4939-9959-f9a5cd642108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:32.117703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1211/2446] 10.222.0.20 () {58 vars in 967 bytes} [Fri Oct 28 19:55:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:32.130250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497f9d3-1a0b-4306-84b0-38198a9ba054 service swift] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:32.140959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497f9d3-1a0b-4306-84b0-38198a9ba054 service swift] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:32.146518 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f624e-1c9a-467a-9ebf-c2056efbf595 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:32.147176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f624e-1c9a-467a-9ebf-c2056efbf595 service swift] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:32.147459 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f624e-1c9a-467a-9ebf-c2056efbf595 service swift] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:32.147735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f624e-1c9a-467a-9ebf-c2056efbf595 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:32.155835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f624e-1c9a-467a-9ebf-c2056efbf595 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:32.157429 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f624e-1c9a-467a-9ebf-c2056efbf595 service swift] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:32.165741 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1236/2447] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:55:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:32.356915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e32d3c-733f-434a-a447-c6998694760b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:32.357202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e32d3c-733f-434a-a447-c6998694760b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:32.357480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e32d3c-733f-434a-a447-c6998694760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:32.375790 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-51e32d3c-733f-434a-a447-c6998694760b None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:32.376994 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-51e32d3c-733f-434a-a447-c6998694760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:32.385565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1212/2448] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:55:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:32.398059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f624e-1c9a-467a-9ebf-c2056efbf595 service swift] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:32.408514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f624e-1c9a-467a-9ebf-c2056efbf595 service swift] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:32.414057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33958-3ce5-479f-89ff-c3134c768748 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:32.414704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33958-3ce5-479f-89ff-c3134c768748 service swift] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:32.414991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33958-3ce5-479f-89ff-c3134c768748 service swift] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:32.415259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33958-3ce5-479f-89ff-c3134c768748 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:32.423538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d33958-3ce5-479f-89ff-c3134c768748 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:32.425130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d33958-3ce5-479f-89ff-c3134c768748 service swift] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:32.435843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1237/2449] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:55:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:32.920709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f49a62-5f22-4cfe-bf6f-90fc9b9a8aab None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:32.920995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f49a62-5f22-4cfe-bf6f-90fc9b9a8aab None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:32.921268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f49a62-5f22-4cfe-bf6f-90fc9b9a8aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:32.939776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-02f49a62-5f22-4cfe-bf6f-90fc9b9a8aab None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:32.940965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-02f49a62-5f22-4cfe-bf6f-90fc9b9a8aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:32.948593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1213/2450] 10.222.0.20 () {58 vars in 967 bytes} [Fri Oct 28 19:55:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:32.960843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33958-3ce5-479f-89ff-c3134c768748 service swift] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:32.971761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33958-3ce5-479f-89ff-c3134c768748 service swift] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:32.977907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd4cc9-2d15-4c9c-875d-8cce28d29d89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:32.978580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd4cc9-2d15-4c9c-875d-8cce28d29d89 service swift] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:32.978862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd4cc9-2d15-4c9c-875d-8cce28d29d89 service swift] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:32.979132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd4cc9-2d15-4c9c-875d-8cce28d29d89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:32.987324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd4cc9-2d15-4c9c-875d-8cce28d29d89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:32.988912 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd4cc9-2d15-4c9c-875d-8cce28d29d89 service swift] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:32.997065 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1238/2451] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:55:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:36.587180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e846b-98ad-4206-872f-ee0636f19cc0 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:36.587748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e846b-98ad-4206-872f-ee0636f19cc0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:36.587748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e846b-98ad-4206-872f-ee0636f19cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:36.606741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-982e846b-98ad-4206-872f-ee0636f19cc0 None None] MFA Rules not processed for user `8d37da96f85e473fbc1d63337261dfea`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:36.607503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-982e846b-98ad-4206-872f-ee0636f19cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:36.666557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1214/2452] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:37.334760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd4cc9-2d15-4c9c-875d-8cce28d29d89 service swift] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:37.337103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5ebd4cc9-2d15-4c9c-875d-8cce28d29d89 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:37.547709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd4cc9-2d15-4c9c-875d-8cce28d29d89 service swift] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:37.552399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:37.553285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:37.553571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:37.553836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] PATH_INFO: `/v3/users/3b3b7b554caf4c98a85276a1802cd0ee` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:37.555525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3b7b554caf4c98a85276a1802cd0ee)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:37.557451 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:37.604019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3b7b554caf4c98a85276a1802cd0ee'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:37.616139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3b7b554caf4c98a85276a1802cd0ee'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:37.616974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3b7b554caf4c98a85276a1802cd0ee'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:37.617581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3b7b554caf4c98a85276a1802cd0ee'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:37.624940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3b7b554caf4c98a85276a1802cd0ee'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:37.636715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1239/2453] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:55:37 2022] DELETE /identity/v3/users/3b3b7b554caf4c98a85276a1802cd0ee => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:55:37.641376 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24508953-c549-48e7-8fdf-539a7b1475f4 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:37.641888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24508953-c549-48e7-8fdf-539a7b1475f4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:37.641888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24508953-c549-48e7-8fdf-539a7b1475f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:37.660175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-24508953-c549-48e7-8fdf-539a7b1475f4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:37.661289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-24508953-c549-48e7-8fdf-539a7b1475f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:37.724391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1215/2454] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:55:37.734456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:37.735912 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:37.793161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111fc74-2632-4e84-bda3-17e9a8708af7 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:37.797815 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e11384-19a2-46a6-b028-1fbd66006377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:37.798520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e11384-19a2-46a6-b028-1fbd66006377 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:37.798801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e11384-19a2-46a6-b028-1fbd66006377 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:37.799070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e11384-19a2-46a6-b028-1fbd66006377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:37.809194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e11384-19a2-46a6-b028-1fbd66006377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:37.810686 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e11384-19a2-46a6-b028-1fbd66006377 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:37.819784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1240/2455] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:37.864855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24508953-c549-48e7-8fdf-539a7b1475f4 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:37.866548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-24508953-c549-48e7-8fdf-539a7b1475f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:37.879050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24508953-c549-48e7-8fdf-539a7b1475f4 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:37.884805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:37.885696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:37.885984 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:37.886292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] PATH_INFO: `/v3/users/dad796159ca142a7a5bc38c92ef91530` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:37.887663 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad796159ca142a7a5bc38c92ef91530)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:37.889603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:37.938248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad796159ca142a7a5bc38c92ef91530'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:37.950017 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad796159ca142a7a5bc38c92ef91530'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:37.950747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad796159ca142a7a5bc38c92ef91530'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:37.959611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad796159ca142a7a5bc38c92ef91530'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:37.960273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad796159ca142a7a5bc38c92ef91530'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:37.974284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1216/2456] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:55:37 2022] DELETE /identity/v3/users/dad796159ca142a7a5bc38c92ef91530 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:55:37.978870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41a37-53b4-4141-aab0-78ec2e2b4def None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:37.979235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41a37-53b4-4141-aab0-78ec2e2b4def None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:37.979811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41a37-53b4-4141-aab0-78ec2e2b4def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:37.995182 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:37.996616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:37.999926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-3fa41a37-53b4-4141-aab0-78ec2e2b4def None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:38.001182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3fa41a37-53b4-4141-aab0-78ec2e2b4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:38.064897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442f6d4-8e56-423e-a51e-52b0f04a59fb admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:38.065762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1241/2457] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:38.072811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:38.073683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.073972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.074340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] PATH_INFO: `/v3/projects/3d0d20df305342d4b51d837233d4063f` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.075547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d0d20df305342d4b51d837233d4063f)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:38.075753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41a37-53b4-4141-aab0-78ec2e2b4def None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:38.077167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3fa41a37-53b4-4141-aab0-78ec2e2b4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:38.077508 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:38.132814 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d0d20df305342d4b51d837233d4063f', 'request_id': 'req-562727c3-36f4-490d-af12-f0b43ec92e80'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:38.134550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41a37-53b4-4141-aab0-78ec2e2b4def None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:38.139468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d0d20df305342d4b51d837233d4063f', 'request_id': 'req-562727c3-36f4-490d-af12-f0b43ec92e80'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:38.148691 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d0d20df305342d4b51d837233d4063f', 'request_id': 'req-562727c3-36f4-490d-af12-f0b43ec92e80'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:38.160168 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] The token cache is being invalidate because project 3d0d20df305342d4b51d837233d4063f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:55:38.160444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:38.161091 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-562727c3-36f4-490d-af12-f0b43ec92e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:38.163356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1217/2458] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:55:37 2022] DELETE /identity/v3/projects/3d0d20df305342d4b51d837233d4063f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:55:38.169796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6881c5a-44e3-46d5-ba7e-506262f9a588 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.170073 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6881c5a-44e3-46d5-ba7e-506262f9a588 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.170375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6881c5a-44e3-46d5-ba7e-506262f9a588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.189914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e6881c5a-44e3-46d5-ba7e-506262f9a588 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:38.191154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e6881c5a-44e3-46d5-ba7e-506262f9a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:38.199655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cb03b-f4fa-4e96-b8b1-8db0e23fe2dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:38.201332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cb03b-f4fa-4e96-b8b1-8db0e23fe2dd service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.201623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cb03b-f4fa-4e96-b8b1-8db0e23fe2dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.202166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cb03b-f4fa-4e96-b8b1-8db0e23fe2dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.204855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-189cb03b-f4fa-4e96-b8b1-8db0e23fe2dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:38.259429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1218/2459] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:55:38.267607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a53405-6848-4b8b-bba8-871189de6a3c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.267917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a53405-6848-4b8b-bba8-871189de6a3c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.268164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a53405-6848-4b8b-bba8-871189de6a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.281070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cb03b-f4fa-4e96-b8b1-8db0e23fe2dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:38.282774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cb03b-f4fa-4e96-b8b1-8db0e23fe2dd service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:38.294134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1242/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:55:38.311900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e8a53405-6848-4b8b-bba8-871189de6a3c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:38.313363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e8a53405-6848-4b8b-bba8-871189de6a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:38.322705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1219/2461] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:55:38.327555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cb03b-f4fa-4e96-b8b1-8db0e23fe2dd service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:38.338312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cb03b-f4fa-4e96-b8b1-8db0e23fe2dd service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:38.344881 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b5ce5-cc88-4328-a69f-3f4e6e35499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:38.345970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b5ce5-cc88-4328-a69f-3f4e6e35499e admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.346696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b5ce5-cc88-4328-a69f-3f4e6e35499e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.347178 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b5ce5-cc88-4328-a69f-3f4e6e35499e admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.348391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b5ce5-cc88-4328-a69f-3f4e6e35499e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:55:38.348987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b5ce5-cc88-4328-a69f-3f4e6e35499e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:38.351647 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b5ce5-cc88-4328-a69f-3f4e6e35499e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:38.365132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1243/2462] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:55:38.369431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a53405-6848-4b8b-bba8-871189de6a3c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:38.391578 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a53405-6848-4b8b-bba8-871189de6a3c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:38.400833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84f014-935b-4061-ae8f-4675263adf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:38.401642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84f014-935b-4061-ae8f-4675263adf13 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.409106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84f014-935b-4061-ae8f-4675263adf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.409843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84f014-935b-4061-ae8f-4675263adf13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.411168 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84f014-935b-4061-ae8f-4675263adf13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:38.413481 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84f014-935b-4061-ae8f-4675263adf13 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:38.463659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b5ce5-cc88-4328-a69f-3f4e6e35499e admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:38.463855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1220/2463] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:55:38 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:55:38.475723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b5ce5-cc88-4328-a69f-3f4e6e35499e admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:38.581561 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a96ad2-c1c0-476c-9535-47aee391508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:38.583004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a96ad2-c1c0-476c-9535-47aee391508c admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.584297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a96ad2-c1c0-476c-9535-47aee391508c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.584860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a96ad2-c1c0-476c-9535-47aee391508c admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.585795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a96ad2-c1c0-476c-9535-47aee391508c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:38.588303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a96ad2-c1c0-476c-9535-47aee391508c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:38.622673 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1244/2464] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:55:38 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:55:38.626683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84f014-935b-4061-ae8f-4675263adf13 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:38.637710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84f014-935b-4061-ae8f-4675263adf13 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:38.651377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447163a-bdf8-4861-a9d5-bb5913f6bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:38.660971 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447163a-bdf8-4861-a9d5-bb5913f6bce8 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.661352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447163a-bdf8-4861-a9d5-bb5913f6bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.661633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447163a-bdf8-4861-a9d5-bb5913f6bce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.662878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447163a-bdf8-4861-a9d5-bb5913f6bce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:38.664940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447163a-bdf8-4861-a9d5-bb5913f6bce8 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:38.683374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1221/2465] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:55:38.684661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a96ad2-c1c0-476c-9535-47aee391508c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:38.702943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a96ad2-c1c0-476c-9535-47aee391508c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:38.716490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c284d5b-4967-45d1-9449-85e49b6b2553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:38.718326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c284d5b-4967-45d1-9449-85e49b6b2553 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.718904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c284d5b-4967-45d1-9449-85e49b6b2553 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.719868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c284d5b-4967-45d1-9449-85e49b6b2553 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.727552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c284d5b-4967-45d1-9449-85e49b6b2553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:38.729205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c284d5b-4967-45d1-9449-85e49b6b2553 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:38.749219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447163a-bdf8-4861-a9d5-bb5913f6bce8 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:38.750266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1245/2466] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:55:38.751994 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5447163a-bdf8-4861-a9d5-bb5913f6bce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:38.753284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c284d5b-4967-45d1-9449-85e49b6b2553 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:38.768368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c284d5b-4967-45d1-9449-85e49b6b2553 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:38.771867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447163a-bdf8-4861-a9d5-bb5913f6bce8 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:38.775119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d50e5-26ae-4811-bf03-c251c250bb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:38.777092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d50e5-26ae-4811-bf03-c251c250bb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.777646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d50e5-26ae-4811-bf03-c251c250bb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.778139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d50e5-26ae-4811-bf03-c251c250bb5f admin admin] PATH_INFO: `/v3/projects/42ce8f3da9ea4ee9a28652bd99014bc0/users/cc688d3f2f7f4230a5715b5ba437ea59/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.788583 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:38.789653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.789850 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.790058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] PATH_INFO: `/v3/projects/6b077e6b908a44a081157227322ff9df` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.791384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b077e6b908a44a081157227322ff9df)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:38.793382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:38.799640 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d50e5-26ae-4811-bf03-c251c250bb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ce8f3da9ea4ee9a28652bd99014bc0, user_id=cc688d3f2f7f4230a5715b5ba437ea59, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:38.820756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d50e5-26ae-4811-bf03-c251c250bb5f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:38.851851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1246/2467] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:55:38 2022] PUT /identity/v3/projects/42ce8f3da9ea4ee9a28652bd99014bc0/users/cc688d3f2f7f4230a5715b5ba437ea59/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:55:38.853324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fad14-fcbb-4f84-b4e9-b6ed11dfb223 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.853716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fad14-fcbb-4f84-b4e9-b6ed11dfb223 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.854103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fad14-fcbb-4f84-b4e9-b6ed11dfb223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.885384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-786fad14-fcbb-4f84-b4e9-b6ed11dfb223 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:38.887130 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-786fad14-fcbb-4f84-b4e9-b6ed11dfb223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:38.895425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b077e6b908a44a081157227322ff9df', 'request_id': 'req-b70e9854-827f-4e0f-9be4-aecaee20c52e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:38.903083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b077e6b908a44a081157227322ff9df', 'request_id': 'req-b70e9854-827f-4e0f-9be4-aecaee20c52e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:38.914059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b077e6b908a44a081157227322ff9df', 'request_id': 'req-b70e9854-827f-4e0f-9be4-aecaee20c52e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:38.933445 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] The token cache is being invalidate because project 6b077e6b908a44a081157227322ff9df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:55:38.933871 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:38.934856 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:55:38.936828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1222/2468] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:55:38 2022] DELETE /identity/v3/projects/6b077e6b908a44a081157227322ff9df => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:55:38.987431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1247/2469] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:39.005506 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:39.006936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:39.070862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e9854-827f-4e0f-9be4-aecaee20c52e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:39.075330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f6cf5-d08f-46d2-a52e-521873fbebe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:39.076275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6cf5-d08f-46d2-a52e-521873fbebe2 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:39.076704 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6cf5-d08f-46d2-a52e-521873fbebe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:39.077462 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f6cf5-d08f-46d2-a52e-521873fbebe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:39.087992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f6cf5-d08f-46d2-a52e-521873fbebe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:39.090335 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f6cf5-d08f-46d2-a52e-521873fbebe2 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:39.103209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1223/2470] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:41.549497 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcd4fb-5a03-43f2-9fd7-31c21c47dc97 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:41.549999 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcd4fb-5a03-43f2-9fd7-31c21c47dc97 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:41.550256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcd4fb-5a03-43f2-9fd7-31c21c47dc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:41.574720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2ffcd4fb-5a03-43f2-9fd7-31c21c47dc97 None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:41.576025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2ffcd4fb-5a03-43f2-9fd7-31c21c47dc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:41.667978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1248/2471] 10.222.0.20 () {58 vars in 967 bytes} [Fri Oct 28 19:55:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:41.682239 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f6cf5-d08f-46d2-a52e-521873fbebe2 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:41.684183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-032f6cf5-d08f-46d2-a52e-521873fbebe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:41.767765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f6cf5-d08f-46d2-a52e-521873fbebe2 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:41.773444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651f63a-8c2a-47e1-afee-77cbce3cc4e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:41.773853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651f63a-8c2a-47e1-afee-77cbce3cc4e4 service swift] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:41.774246 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651f63a-8c2a-47e1-afee-77cbce3cc4e4 service swift] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:41.774522 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651f63a-8c2a-47e1-afee-77cbce3cc4e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:41.783604 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651f63a-8c2a-47e1-afee-77cbce3cc4e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:41.785206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651f63a-8c2a-47e1-afee-77cbce3cc4e4 service swift] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:41.802287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1224/2472] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:55:43.876954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50dace-fcfe-4bbb-b5f6-4055876b9dcc None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:43.877494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50dace-fcfe-4bbb-b5f6-4055876b9dcc None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:43.877494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50dace-fcfe-4bbb-b5f6-4055876b9dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:43.908953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-9c50dace-fcfe-4bbb-b5f6-4055876b9dcc None None] MFA Rules not processed for user `cc688d3f2f7f4230a5715b5ba437ea59`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:43.910463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9c50dace-fcfe-4bbb-b5f6-4055876b9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:43.977317 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1249/2473] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:43.982226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651f63a-8c2a-47e1-afee-77cbce3cc4e4 service swift] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:43.983684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8651f63a-8c2a-47e1-afee-77cbce3cc4e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:43.997358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651f63a-8c2a-47e1-afee-77cbce3cc4e4 service swift] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:44.001790 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6f80f-c064-40dc-addc-5215cc11e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:44.002502 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6f80f-c064-40dc-addc-5215cc11e0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:44.002786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6f80f-c064-40dc-addc-5215cc11e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:44.003059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6f80f-c064-40dc-addc-5215cc11e0b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:44.003797 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6f80f-c064-40dc-addc-5215cc11e0b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:44.005728 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6f80f-c064-40dc-addc-5215cc11e0b9 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:44.032895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1225/2474] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:55:43 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:55:44.037171 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50dace-fcfe-4bbb-b5f6-4055876b9dcc None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:44.049049 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50dace-fcfe-4bbb-b5f6-4055876b9dcc None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:44.104389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4352d-9d8e-40f1-8684-69f6a3f57cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:44.105081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4352d-9d8e-40f1-8684-69f6a3f57cbe admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:44.105345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4352d-9d8e-40f1-8684-69f6a3f57cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:44.105637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4352d-9d8e-40f1-8684-69f6a3f57cbe admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:44.106430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4352d-9d8e-40f1-8684-69f6a3f57cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:44.108390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4352d-9d8e-40f1-8684-69f6a3f57cbe admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:44.129679 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1250/2475] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:55:44 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:55:44.133857 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6f80f-c064-40dc-addc-5215cc11e0b9 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:44.145105 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6f80f-c064-40dc-addc-5215cc11e0b9 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:44.149669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13832e-c31d-4a74-8ae7-46eeba41f8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:44.150375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13832e-c31d-4a74-8ae7-46eeba41f8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:44.150653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13832e-c31d-4a74-8ae7-46eeba41f8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:44.150924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13832e-c31d-4a74-8ae7-46eeba41f8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:44.151650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13832e-c31d-4a74-8ae7-46eeba41f8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:44.153339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13832e-c31d-4a74-8ae7-46eeba41f8f6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:44.165696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1226/2476] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:55:44.169404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4352d-9d8e-40f1-8684-69f6a3f57cbe admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:44.179987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4352d-9d8e-40f1-8684-69f6a3f57cbe admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:44.184899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997c924-898b-4108-88fb-9fb5f141cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:44.185804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c924-898b-4108-88fb-9fb5f141cc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:44.186116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c924-898b-4108-88fb-9fb5f141cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:44.186381 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c924-898b-4108-88fb-9fb5f141cc04 admin admin] PATH_INFO: `/v3/projects/022f27384de949da85cb2b4b8c35c0dc/users/117cd5f9da40458f8a6f1cc2d9356562/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:44.202947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997c924-898b-4108-88fb-9fb5f141cc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=022f27384de949da85cb2b4b8c35c0dc, user_id=117cd5f9da40458f8a6f1cc2d9356562, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:44.205722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997c924-898b-4108-88fb-9fb5f141cc04 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:44.220801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1251/2477] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:55:44 2022] PUT /identity/v3/projects/022f27384de949da85cb2b4b8c35c0dc/users/117cd5f9da40458f8a6f1cc2d9356562/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:55:44.225060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13832e-c31d-4a74-8ae7-46eeba41f8f6 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:44.235593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13832e-c31d-4a74-8ae7-46eeba41f8f6 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:44.292468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e3430-1c09-4e8a-bdcb-abedf3f34d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:44.293181 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3430-1c09-4e8a-bdcb-abedf3f34d9e admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:44.293463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3430-1c09-4e8a-bdcb-abedf3f34d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:44.293734 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3430-1c09-4e8a-bdcb-abedf3f34d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:44.294500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e3430-1c09-4e8a-bdcb-abedf3f34d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:44.296101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e3430-1c09-4e8a-bdcb-abedf3f34d9e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:44.306149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1227/2478] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:55:44.311687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997c924-898b-4108-88fb-9fb5f141cc04 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:44.323112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997c924-898b-4108-88fb-9fb5f141cc04 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:44.328642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d33963-5932-4d42-ba38-c8fe055c681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:44.329569 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d33963-5932-4d42-ba38-c8fe055c681b admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:44.329850 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d33963-5932-4d42-ba38-c8fe055c681b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:44.330158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d33963-5932-4d42-ba38-c8fe055c681b admin admin] PATH_INFO: `/v3/projects/022f27384de949da85cb2b4b8c35c0dc/users/117cd5f9da40458f8a6f1cc2d9356562/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:44.332191 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d33963-5932-4d42-ba38-c8fe055c681b admin admin] RBAC: Authorizing `identity:create_grant(project_id=022f27384de949da85cb2b4b8c35c0dc, user_id=117cd5f9da40458f8a6f1cc2d9356562, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:44.334897 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d33963-5932-4d42-ba38-c8fe055c681b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:44.346847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1252/2479] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:55:44 2022] PUT /identity/v3/projects/022f27384de949da85cb2b4b8c35c0dc/users/117cd5f9da40458f8a6f1cc2d9356562/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:55:49.032243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4c5fb-499e-407f-8256-8d3c0777175d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:49.032747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4c5fb-499e-407f-8256-8d3c0777175d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:49.032747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4c5fb-499e-407f-8256-8d3c0777175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:49.064884 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f3c4c5fb-499e-407f-8256-8d3c0777175d None None] MFA Rules not processed for user `117cd5f9da40458f8a6f1cc2d9356562`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:49.066415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f3c4c5fb-499e-407f-8256-8d3c0777175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:49.139944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1228/2480] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:55:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:49.153989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d33963-5932-4d42-ba38-c8fe055c681b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:49.155805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-11d33963-5932-4d42-ba38-c8fe055c681b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:49.274334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d33963-5932-4d42-ba38-c8fe055c681b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:49.280759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84ead0-7918-49ad-8090-b5c9a8e41c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:49.281437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ead0-7918-49ad-8090-b5c9a8e41c1c service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:49.281711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ead0-7918-49ad-8090-b5c9a8e41c1c service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:49.281985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ead0-7918-49ad-8090-b5c9a8e41c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:49.343943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84ead0-7918-49ad-8090-b5c9a8e41c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:49.346344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84ead0-7918-49ad-8090-b5c9a8e41c1c service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:49.356899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1253/2481] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:56:10.265228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65db89-f999-4709-a2e8-2e6ea5ca6c04 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:56:10.265866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65db89-f999-4709-a2e8-2e6ea5ca6c04 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:56:10.265866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65db89-f999-4709-a2e8-2e6ea5ca6c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:56:10.283475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-bc65db89-f999-4709-a2e8-2e6ea5ca6c04 None None] MFA Rules not processed for user `cc688d3f2f7f4230a5715b5ba437ea59`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:56:10.284709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bc65db89-f999-4709-a2e8-2e6ea5ca6c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:56:10.292316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1229/2482] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:56:28.337360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84ead0-7918-49ad-8090-b5c9a8e41c1c service nova] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:56:28.339210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4e84ead0-7918-49ad-8090-b5c9a8e41c1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:56:28.401166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84ead0-7918-49ad-8090-b5c9a8e41c1c service nova] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:56:28.405701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ef408-029e-4e0c-9906-aede29204b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:56:28.406378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef408-029e-4e0c-9906-aede29204b2c service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:56:28.406657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef408-029e-4e0c-9906-aede29204b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:56:28.406913 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef408-029e-4e0c-9906-aede29204b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:56:28.416440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ef408-029e-4e0c-9906-aede29204b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:56:28.417876 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ef408-029e-4e0c-9906-aede29204b2c service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:56:28.427313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1254/2483] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:56:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:56:32.928136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e585b-9990-43d5-b4a6-9ad3bc12430d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:56:32.928698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e585b-9990-43d5-b4a6-9ad3bc12430d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:56:32.928698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e585b-9990-43d5-b4a6-9ad3bc12430d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:56:32.949175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-624e585b-9990-43d5-b4a6-9ad3bc12430d None None] MFA Rules not processed for user `6c853d04dd5147f5961bf551b608da33`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:56:32.951009 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-624e585b-9990-43d5-b4a6-9ad3bc12430d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:56:33.009126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1230/2484] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:56:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:56:41.312696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ef408-029e-4e0c-9906-aede29204b2c service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:56:41.314425 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-657ef408-029e-4e0c-9906-aede29204b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:56:41.378559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ef408-029e-4e0c-9906-aede29204b2c service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:56:41.383809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:56:41.384714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:56:41.384986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:56:41.385238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] PATH_INFO: `/v3/users/8d37da96f85e473fbc1d63337261dfea` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:56:41.386484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d37da96f85e473fbc1d63337261dfea)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:56:41.389051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:56:41.437968 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d37da96f85e473fbc1d63337261dfea'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:56:41.449034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d37da96f85e473fbc1d63337261dfea'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:56:41.449692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d37da96f85e473fbc1d63337261dfea'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:56:41.450357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d37da96f85e473fbc1d63337261dfea'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:56:41.458669 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e82a695d-7b1d-4f89-9d49-e5d9133c1f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d37da96f85e473fbc1d63337261dfea'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:56:41.470569 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1255/2485] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:56:41 2022] DELETE /identity/v3/users/8d37da96f85e473fbc1d63337261dfea => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:56:41.645498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e585b-9990-43d5-b4a6-9ad3bc12430d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:56:41.658867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e585b-9990-43d5-b4a6-9ad3bc12430d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:56:41.725038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:56:41.725913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:56:41.726372 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:56:41.726651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] PATH_INFO: `/v3/projects/d863fb655bdd48fa99b9c1b9750dfb38` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:56:41.727943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d863fb655bdd48fa99b9c1b9750dfb38)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:56:41.729749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:56:41.776472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd863fb655bdd48fa99b9c1b9750dfb38', 'request_id': 'req-2cc690a3-7062-4caf-8d78-f016639a5bf2'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:56:41.782459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd863fb655bdd48fa99b9c1b9750dfb38', 'request_id': 'req-2cc690a3-7062-4caf-8d78-f016639a5bf2'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:56:41.790598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd863fb655bdd48fa99b9c1b9750dfb38', 'request_id': 'req-2cc690a3-7062-4caf-8d78-f016639a5bf2'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:56:41.800527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] The token cache is being invalidate because project d863fb655bdd48fa99b9c1b9750dfb38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:56:41.800806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:56:41.801422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:56:41.803008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1231/2486] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:56:41 2022] DELETE /identity/v3/projects/d863fb655bdd48fa99b9c1b9750dfb38 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:56:48.551623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8fbb1-1895-49ea-8c65-e521abf141e3 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:56:48.552085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8fbb1-1895-49ea-8c65-e521abf141e3 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:56:48.552194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8fbb1-1895-49ea-8c65-e521abf141e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:56:48.569423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-52d8fbb1-1895-49ea-8c65-e521abf141e3 None None] MFA Rules not processed for user `36c4bc5fb79b455fba3c684645fca939`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:56:48.570613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-52d8fbb1-1895-49ea-8c65-e521abf141e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:56:48.626813 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1256/2487] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:56:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:29.332624 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:29.335024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:29.407131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc690a3-7062-4caf-8d78-f016639a5bf2 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:29.411372 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb5b81-d5eb-46e0-9e00-58dd4ef267cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:29.412026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb5b81-d5eb-46e0-9e00-58dd4ef267cf service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:29.412301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb5b81-d5eb-46e0-9e00-58dd4ef267cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:29.412564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb5b81-d5eb-46e0-9e00-58dd4ef267cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:29.414867 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-94eb5b81-d5eb-46e0-9e00-58dd4ef267cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:29.493240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb5b81-d5eb-46e0-9e00-58dd4ef267cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:29.494739 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb5b81-d5eb-46e0-9e00-58dd4ef267cf service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:29.506150 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1232/2488] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:30.055855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8fbb1-1895-49ea-8c65-e521abf141e3 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:30.057361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-52d8fbb1-1895-49ea-8c65-e521abf141e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:30.069964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8fbb1-1895-49ea-8c65-e521abf141e3 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:30.073942 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0d40c-2ece-47d6-b0b6-15f3802e85f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:30.074637 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0d40c-2ece-47d6-b0b6-15f3802e85f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:30.074944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0d40c-2ece-47d6-b0b6-15f3802e85f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:30.075256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0d40c-2ece-47d6-b0b6-15f3802e85f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:30.077526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-afa0d40c-2ece-47d6-b0b6-15f3802e85f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:30.091427 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0d40c-2ece-47d6-b0b6-15f3802e85f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:30.092939 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0d40c-2ece-47d6-b0b6-15f3802e85f3 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:30.105203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1257/2489] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:36.254919 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb5b81-d5eb-46e0-9e00-58dd4ef267cf service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:36.264922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb5b81-d5eb-46e0-9e00-58dd4ef267cf service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:36.269155 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8fda6-2b6a-450e-8488-2a53a27f53fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:36.269803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8fda6-2b6a-450e-8488-2a53a27f53fa service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:36.270108 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8fda6-2b6a-450e-8488-2a53a27f53fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:36.270378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8fda6-2b6a-450e-8488-2a53a27f53fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:36.272167 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-99b8fda6-2b6a-450e-8488-2a53a27f53fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:36.339577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8fda6-2b6a-450e-8488-2a53a27f53fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:36.341027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8fda6-2b6a-450e-8488-2a53a27f53fa service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:36.351520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1233/2490] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:39.899111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0d40c-2ece-47d6-b0b6-15f3802e85f3 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:39.900794 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-afa0d40c-2ece-47d6-b0b6-15f3802e85f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:39.916169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0d40c-2ece-47d6-b0b6-15f3802e85f3 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:39.921198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:39.922338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.922610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.922874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] PATH_INFO: `/v3/users/6c853d04dd5147f5961bf551b608da33` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.924301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c853d04dd5147f5961bf551b608da33)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:39.926284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:39.974070 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c853d04dd5147f5961bf551b608da33'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:39.986228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c853d04dd5147f5961bf551b608da33'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:39.986917 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c853d04dd5147f5961bf551b608da33'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:39.987609 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c853d04dd5147f5961bf551b608da33'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:39.998639 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3e99010f-e443-4a6e-b85c-604bf35d49a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c853d04dd5147f5961bf551b608da33'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:40.011874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1258/2491] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:39 2022] DELETE /identity/v3/users/6c853d04dd5147f5961bf551b608da33 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:40.187456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8fda6-2b6a-450e-8488-2a53a27f53fa service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.198829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8fda6-2b6a-450e-8488-2a53a27f53fa service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.257745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.258633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.258926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.259196 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] PATH_INFO: `/v3/projects/ba374b2de5324250b7cd9383ea5d1a1e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.260845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba374b2de5324250b7cd9383ea5d1a1e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.262829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.310098 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba374b2de5324250b7cd9383ea5d1a1e', 'request_id': 'req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:40.316433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba374b2de5324250b7cd9383ea5d1a1e', 'request_id': 'req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:40.327242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba374b2de5324250b7cd9383ea5d1a1e', 'request_id': 'req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:40.343041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] The token cache is being invalidate because project ba374b2de5324250b7cd9383ea5d1a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:40.343511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:40.344576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-7ab11ded-4a9a-4766-8e65-542bf21ef9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:40.346869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1234/2492] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:40 2022] DELETE /identity/v3/projects/ba374b2de5324250b7cd9383ea5d1a1e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:40.357615 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c4959-14b5-484c-9ee8-38cf1fa96486 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.357798 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c4959-14b5-484c-9ee8-38cf1fa96486 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.358115 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c4959-14b5-484c-9ee8-38cf1fa96486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.377207 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-636c4959-14b5-484c-9ee8-38cf1fa96486 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:40.378455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-636c4959-14b5-484c-9ee8-38cf1fa96486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:40.437652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1259/2493] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:40.446827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37fb39-a18d-4543-9939-15912272efbe None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.447195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37fb39-a18d-4543-9939-15912272efbe None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.447559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37fb39-a18d-4543-9939-15912272efbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.474261 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-7d37fb39-a18d-4543-9939-15912272efbe None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:40.475666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7d37fb39-a18d-4543-9939-15912272efbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:40.484786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1235/2494] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:40.489231 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c4959-14b5-484c-9ee8-38cf1fa96486 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.499259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c4959-14b5-484c-9ee8-38cf1fa96486 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.504216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13399ea7-270f-4979-8adc-85729fd90a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.504868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13399ea7-270f-4979-8adc-85729fd90a17 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.505142 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13399ea7-270f-4979-8adc-85729fd90a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.505414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13399ea7-270f-4979-8adc-85729fd90a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.506158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13399ea7-270f-4979-8adc-85729fd90a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:40.506483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13399ea7-270f-4979-8adc-85729fd90a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.508085 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13399ea7-270f-4979-8adc-85729fd90a17 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.519608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1260/2495] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:57:40.523985 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37fb39-a18d-4543-9939-15912272efbe None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.533735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37fb39-a18d-4543-9939-15912272efbe None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.540132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5878d-fd5b-4dd7-8b23-5a5efc8fe282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.540786 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5878d-fd5b-4dd7-8b23-5a5efc8fe282 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.541064 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5878d-fd5b-4dd7-8b23-5a5efc8fe282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.541335 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5878d-fd5b-4dd7-8b23-5a5efc8fe282 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.542024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5878d-fd5b-4dd7-8b23-5a5efc8fe282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.543982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5878d-fd5b-4dd7-8b23-5a5efc8fe282 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.575697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1236/2496] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:40 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:40.577101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13399ea7-270f-4979-8adc-85729fd90a17 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.587271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13399ea7-270f-4979-8adc-85729fd90a17 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.644690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b8c07-985c-4b10-951f-65f8c4465198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.644848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b8c07-985c-4b10-951f-65f8c4465198 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.645120 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b8c07-985c-4b10-951f-65f8c4465198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.645417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b8c07-985c-4b10-951f-65f8c4465198 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.646114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b8c07-985c-4b10-951f-65f8c4465198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.648073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b8c07-985c-4b10-951f-65f8c4465198 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.671735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1261/2497] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:40 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:40.676305 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5878d-fd5b-4dd7-8b23-5a5efc8fe282 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.686661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5878d-fd5b-4dd7-8b23-5a5efc8fe282 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.691705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0417f62-33e9-4f85-8a18-2e14434d08ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.692392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0417f62-33e9-4f85-8a18-2e14434d08ed admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.692672 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0417f62-33e9-4f85-8a18-2e14434d08ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.692944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0417f62-33e9-4f85-8a18-2e14434d08ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.693657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0417f62-33e9-4f85-8a18-2e14434d08ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.695286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0417f62-33e9-4f85-8a18-2e14434d08ed admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.705666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1237/2498] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:40.710132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b8c07-985c-4b10-951f-65f8c4465198 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.723731 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b8c07-985c-4b10-951f-65f8c4465198 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.731909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba95fe-6fad-44b7-a52a-0e52ba7f0d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.732771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba95fe-6fad-44b7-a52a-0e52ba7f0d0f admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.733050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba95fe-6fad-44b7-a52a-0e52ba7f0d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.733430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba95fe-6fad-44b7-a52a-0e52ba7f0d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.734573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba95fe-6fad-44b7-a52a-0e52ba7f0d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.736677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba95fe-6fad-44b7-a52a-0e52ba7f0d0f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.747122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1262/2499] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:40.751428 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0417f62-33e9-4f85-8a18-2e14434d08ed admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.762043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0417f62-33e9-4f85-8a18-2e14434d08ed admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.768076 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d9d9-eb30-4998-92e8-1d8a1e7f7a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.768968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d9d9-eb30-4998-92e8-1d8a1e7f7a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.769240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d9d9-eb30-4998-92e8-1d8a1e7f7a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.769541 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d9d9-eb30-4998-92e8-1d8a1e7f7a70 admin admin] PATH_INFO: `/v3/projects/5c1eb6e4b8cc4ef9b36ab31aa8e1e7b0/users/c1764424d8964cb894481a83c879b737/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.784475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1d9d9-eb30-4998-92e8-1d8a1e7f7a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1eb6e4b8cc4ef9b36ab31aa8e1e7b0, user_id=c1764424d8964cb894481a83c879b737, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.787158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1d9d9-eb30-4998-92e8-1d8a1e7f7a70 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.803229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1238/2500] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:40 2022] PUT /identity/v3/projects/5c1eb6e4b8cc4ef9b36ab31aa8e1e7b0/users/c1764424d8964cb894481a83c879b737/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:40.814868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf12e71-e92a-43cb-ae0c-0ab88c02b98f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.815149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf12e71-e92a-43cb-ae0c-0ab88c02b98f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.815425 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf12e71-e92a-43cb-ae0c-0ab88c02b98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.841313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0cf12e71-e92a-43cb-ae0c-0ab88c02b98f None None] MFA Rules not processed for user `c1764424d8964cb894481a83c879b737`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:40.842561 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0cf12e71-e92a-43cb-ae0c-0ab88c02b98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:40.907842 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1263/2501] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:40.915127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d9d9-eb30-4998-92e8-1d8a1e7f7a70 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.984125 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d9d9-eb30-4998-92e8-1d8a1e7f7a70 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.989707 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4417ac-9f29-4eab-82eb-eeeb5d54cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.990424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4417ac-9f29-4eab-82eb-eeeb5d54cf63 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.990705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4417ac-9f29-4eab-82eb-eeeb5d54cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.990983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4417ac-9f29-4eab-82eb-eeeb5d54cf63 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.991680 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4417ac-9f29-4eab-82eb-eeeb5d54cf63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.993616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4417ac-9f29-4eab-82eb-eeeb5d54cf63 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.021945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1239/2502] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:40 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:41.027724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf12e71-e92a-43cb-ae0c-0ab88c02b98f None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.039045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf12e71-e92a-43cb-ae0c-0ab88c02b98f None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.096919 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1d4db-6ccf-4bdb-9e0a-159f0deb2513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.097585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d4db-6ccf-4bdb-9e0a-159f0deb2513 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.097866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d4db-6ccf-4bdb-9e0a-159f0deb2513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.098169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d4db-6ccf-4bdb-9e0a-159f0deb2513 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.098863 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1d4db-6ccf-4bdb-9e0a-159f0deb2513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.100810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1d4db-6ccf-4bdb-9e0a-159f0deb2513 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.122729 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1264/2503] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:41 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:41.127068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4417ac-9f29-4eab-82eb-eeeb5d54cf63 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.137556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4417ac-9f29-4eab-82eb-eeeb5d54cf63 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.142751 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96bfba-f2bb-493f-8b0b-9812a154df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.143415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96bfba-f2bb-493f-8b0b-9812a154df12 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.143693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96bfba-f2bb-493f-8b0b-9812a154df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.143964 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96bfba-f2bb-493f-8b0b-9812a154df12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.144694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96bfba-f2bb-493f-8b0b-9812a154df12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.146330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96bfba-f2bb-493f-8b0b-9812a154df12 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.156816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1240/2504] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:41.161388 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1d4db-6ccf-4bdb-9e0a-159f0deb2513 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.171911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1d4db-6ccf-4bdb-9e0a-159f0deb2513 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.177263 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e1bd7-1142-4819-aff7-dd4f912e0ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.178197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e1bd7-1142-4819-aff7-dd4f912e0ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.178481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e1bd7-1142-4819-aff7-dd4f912e0ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.178754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e1bd7-1142-4819-aff7-dd4f912e0ec2 admin admin] PATH_INFO: `/v3/projects/1103ec900070405b8443c5e498155fd2/users/c6110d5893da4d36b3821a8c54b2b604/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.193715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e1bd7-1142-4819-aff7-dd4f912e0ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1103ec900070405b8443c5e498155fd2, user_id=c6110d5893da4d36b3821a8c54b2b604, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.196422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e1bd7-1142-4819-aff7-dd4f912e0ec2 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.210785 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1265/2505] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:41 2022] PUT /identity/v3/projects/1103ec900070405b8443c5e498155fd2/users/c6110d5893da4d36b3821a8c54b2b604/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:41.214916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96bfba-f2bb-493f-8b0b-9812a154df12 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.225425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96bfba-f2bb-493f-8b0b-9812a154df12 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.281836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f9ab4-a856-474d-b26d-8e4c327e4e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.282586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f9ab4-a856-474d-b26d-8e4c327e4e5a admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.282906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f9ab4-a856-474d-b26d-8e4c327e4e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.283170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f9ab4-a856-474d-b26d-8e4c327e4e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.283914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f9ab4-a856-474d-b26d-8e4c327e4e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.285500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f9ab4-a856-474d-b26d-8e4c327e4e5a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.295596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1241/2506] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:41.300661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e1bd7-1142-4819-aff7-dd4f912e0ec2 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.315779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e1bd7-1142-4819-aff7-dd4f912e0ec2 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.321073 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ce48e-8f71-4a22-9af9-8b9e632b667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.321953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ce48e-8f71-4a22-9af9-8b9e632b667d admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.322258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ce48e-8f71-4a22-9af9-8b9e632b667d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.322530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ce48e-8f71-4a22-9af9-8b9e632b667d admin admin] PATH_INFO: `/v3/projects/1103ec900070405b8443c5e498155fd2/users/c6110d5893da4d36b3821a8c54b2b604/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.324579 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ce48e-8f71-4a22-9af9-8b9e632b667d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1103ec900070405b8443c5e498155fd2, user_id=c6110d5893da4d36b3821a8c54b2b604, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.327250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ce48e-8f71-4a22-9af9-8b9e632b667d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.338361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1266/2507] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:41 2022] PUT /identity/v3/projects/1103ec900070405b8443c5e498155fd2/users/c6110d5893da4d36b3821a8c54b2b604/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:41.350575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03f713-d2c6-48d7-b049-6e51c86e6b3f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.350916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03f713-d2c6-48d7-b049-6e51c86e6b3f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.351312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03f713-d2c6-48d7-b049-6e51c86e6b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.384855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0f03f713-d2c6-48d7-b049-6e51c86e6b3f None None] MFA Rules not processed for user `c6110d5893da4d36b3821a8c54b2b604`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:41.386062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0f03f713-d2c6-48d7-b049-6e51c86e6b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:41.455505 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1242/2508] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:41.468124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ce48e-8f71-4a22-9af9-8b9e632b667d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.470237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ed4ce48e-8f71-4a22-9af9-8b9e632b667d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:41.556940 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ce48e-8f71-4a22-9af9-8b9e632b667d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.561570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eb358-91ed-49d8-8c53-11daa2cdf972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.562262 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb358-91ed-49d8-8c53-11daa2cdf972 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.562545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb358-91ed-49d8-8c53-11daa2cdf972 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.562819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb358-91ed-49d8-8c53-11daa2cdf972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.572445 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb358-91ed-49d8-8c53-11daa2cdf972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.573791 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb358-91ed-49d8-8c53-11daa2cdf972 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.583779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1267/2509] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:42.133395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03f713-d2c6-48d7-b049-6e51c86e6b3f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:42.206579 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03f713-d2c6-48d7-b049-6e51c86e6b3f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:42.211825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:42.212665 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:42.212953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:42.213226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] PATH_INFO: `/v3/users/c1764424d8964cb894481a83c879b737` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:42.214521 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1764424d8964cb894481a83c879b737)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:42.216465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:42.264133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1764424d8964cb894481a83c879b737'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.275610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1764424d8964cb894481a83c879b737'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.276281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1764424d8964cb894481a83c879b737'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.285658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1764424d8964cb894481a83c879b737'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.286372 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1764424d8964cb894481a83c879b737'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.298575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1243/2510] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:42 2022] DELETE /identity/v3/users/c1764424d8964cb894481a83c879b737 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:42.303237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8263fd-4481-4fbc-8a03-2976529b836f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:42.303705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8263fd-4481-4fbc-8a03-2976529b836f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:42.303816 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8263fd-4481-4fbc-8a03-2976529b836f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:42.321602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2d8263fd-4481-4fbc-8a03-2976529b836f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:42.322848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2d8263fd-4481-4fbc-8a03-2976529b836f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:42.383716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1268/2511] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:42.395221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:42.396865 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:42.454651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2f747-c6cd-4e6c-95f0-918eb37bcbba admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:42.458755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23118b0b-e23d-4318-b11f-22981e3ec905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:42.459394 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23118b0b-e23d-4318-b11f-22981e3ec905 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:42.459672 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23118b0b-e23d-4318-b11f-22981e3ec905 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:42.459941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23118b0b-e23d-4318-b11f-22981e3ec905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:42.469263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23118b0b-e23d-4318-b11f-22981e3ec905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:42.470668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23118b0b-e23d-4318-b11f-22981e3ec905 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:42.480126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1244/2512] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:42.754315 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8263fd-4481-4fbc-8a03-2976529b836f None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:42.755905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2d8263fd-4481-4fbc-8a03-2976529b836f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:42.768483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8263fd-4481-4fbc-8a03-2976529b836f None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:42.775012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:42.775897 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:42.776176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:42.776447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] PATH_INFO: `/v3/projects/5c1eb6e4b8cc4ef9b36ab31aa8e1e7b0` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:42.777773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1eb6e4b8cc4ef9b36ab31aa8e1e7b0)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:42.779754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:42.830469 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1eb6e4b8cc4ef9b36ab31aa8e1e7b0', 'request_id': 'req-c35a362a-5b5c-4422-b355-a837f3c63f7b'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.836436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1eb6e4b8cc4ef9b36ab31aa8e1e7b0', 'request_id': 'req-c35a362a-5b5c-4422-b355-a837f3c63f7b'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.846672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1eb6e4b8cc4ef9b36ab31aa8e1e7b0', 'request_id': 'req-c35a362a-5b5c-4422-b355-a837f3c63f7b'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.856690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] The token cache is being invalidate because project 5c1eb6e4b8cc4ef9b36ab31aa8e1e7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:42.856971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.857590 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.859196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1269/2513] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:42 2022] DELETE /identity/v3/projects/5c1eb6e4b8cc4ef9b36ab31aa8e1e7b0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:42.863300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23118b0b-e23d-4318-b11f-22981e3ec905 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:42.873438 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23118b0b-e23d-4318-b11f-22981e3ec905 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:42.933176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:42.934053 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:42.934385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:42.934653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] PATH_INFO: `/v3/users/c6110d5893da4d36b3821a8c54b2b604` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:42.935975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6110d5893da4d36b3821a8c54b2b604)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:42.937928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:42.988850 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6110d5893da4d36b3821a8c54b2b604'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.001332 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6110d5893da4d36b3821a8c54b2b604'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.002020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6110d5893da4d36b3821a8c54b2b604'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.012753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6110d5893da4d36b3821a8c54b2b604'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.013407 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6c22152c-e572-48c8-bda6-8306363138f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6110d5893da4d36b3821a8c54b2b604'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.026508 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1245/2514] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:42 2022] DELETE /identity/v3/users/c6110d5893da4d36b3821a8c54b2b604 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:43.300331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:43.301787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:43.314550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a362a-5b5c-4422-b355-a837f3c63f7b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:43.369763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:43.370668 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.370937 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.371201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] PATH_INFO: `/v3/projects/1103ec900070405b8443c5e498155fd2` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.372394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1103ec900070405b8443c5e498155fd2)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:43.374321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:43.423278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1103ec900070405b8443c5e498155fd2', 'request_id': 'req-633101f7-894f-467f-9a10-08dc07ff96b2'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.429599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1103ec900070405b8443c5e498155fd2', 'request_id': 'req-633101f7-894f-467f-9a10-08dc07ff96b2'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.438524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1103ec900070405b8443c5e498155fd2', 'request_id': 'req-633101f7-894f-467f-9a10-08dc07ff96b2'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.448374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] The token cache is being invalidate because project 1103ec900070405b8443c5e498155fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:43.448651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.449259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-633101f7-894f-467f-9a10-08dc07ff96b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.450818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1270/2515] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:43 2022] DELETE /identity/v3/projects/1103ec900070405b8443c5e498155fd2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:43.455913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05594d2-81de-4434-9469-027fe071e0ea None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.456415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05594d2-81de-4434-9469-027fe071e0ea None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.456415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05594d2-81de-4434-9469-027fe071e0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.475761 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f05594d2-81de-4434-9469-027fe071e0ea None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:43.476953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f05594d2-81de-4434-9469-027fe071e0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:43.536267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1246/2516] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:43.546197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104047da-ee8a-49a6-8eb1-e7ed610f39c1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.546422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104047da-ee8a-49a6-8eb1-e7ed610f39c1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.546690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104047da-ee8a-49a6-8eb1-e7ed610f39c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.566329 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-104047da-ee8a-49a6-8eb1-e7ed610f39c1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:43.567531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-104047da-ee8a-49a6-8eb1-e7ed610f39c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:43.577356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1271/2517] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:43.581534 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05594d2-81de-4434-9469-027fe071e0ea None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:43.591476 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05594d2-81de-4434-9469-027fe071e0ea None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:43.596412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8520a1-a279-420c-8002-67ab265308bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:43.597064 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8520a1-a279-420c-8002-67ab265308bf admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.597347 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8520a1-a279-420c-8002-67ab265308bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.597622 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8520a1-a279-420c-8002-67ab265308bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.598385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8520a1-a279-420c-8002-67ab265308bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:43.598688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8520a1-a279-420c-8002-67ab265308bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:43.600399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8520a1-a279-420c-8002-67ab265308bf admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:43.611863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1247/2518] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:43.616250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104047da-ee8a-49a6-8eb1-e7ed610f39c1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:43.625532 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104047da-ee8a-49a6-8eb1-e7ed610f39c1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:43.631234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202a344-1c64-4411-840f-47fce845f32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:43.631983 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a344-1c64-4411-840f-47fce845f32a admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.632260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a344-1c64-4411-840f-47fce845f32a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.632515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a344-1c64-4411-840f-47fce845f32a admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.633192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202a344-1c64-4411-840f-47fce845f32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:43.635211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202a344-1c64-4411-840f-47fce845f32a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:43.662955 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1272/2519] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:43 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:43.669648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8520a1-a279-420c-8002-67ab265308bf admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:43.679596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8520a1-a279-420c-8002-67ab265308bf admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:43.740851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d216b6-e1a7-4f6b-9df5-e9a6f7499ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:43.741522 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d216b6-e1a7-4f6b-9df5-e9a6f7499ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.741800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d216b6-e1a7-4f6b-9df5-e9a6f7499ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.742117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d216b6-e1a7-4f6b-9df5-e9a6f7499ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.742799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d216b6-e1a7-4f6b-9df5-e9a6f7499ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:43.744746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d216b6-e1a7-4f6b-9df5-e9a6f7499ca1 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:43.770810 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1248/2520] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:43 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:43.775080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202a344-1c64-4411-840f-47fce845f32a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:43.785242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202a344-1c64-4411-840f-47fce845f32a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:43.790422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878fa06-4e66-45de-a632-a9fa7c1542a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:43.791083 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878fa06-4e66-45de-a632-a9fa7c1542a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.791357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878fa06-4e66-45de-a632-a9fa7c1542a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.791620 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878fa06-4e66-45de-a632-a9fa7c1542a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.792341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878fa06-4e66-45de-a632-a9fa7c1542a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:43.793933 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878fa06-4e66-45de-a632-a9fa7c1542a3 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:43.804581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1273/2521] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:43.808698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d216b6-e1a7-4f6b-9df5-e9a6f7499ca1 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:43.819358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d216b6-e1a7-4f6b-9df5-e9a6f7499ca1 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:43.825112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e415dd4-9cc6-4d84-bb8d-23da74bc7fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:43.825780 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e415dd4-9cc6-4d84-bb8d-23da74bc7fdd admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.826123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e415dd4-9cc6-4d84-bb8d-23da74bc7fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.826397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e415dd4-9cc6-4d84-bb8d-23da74bc7fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.827127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e415dd4-9cc6-4d84-bb8d-23da74bc7fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:43.828720 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e415dd4-9cc6-4d84-bb8d-23da74bc7fdd admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:43.838841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1249/2522] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:43.843042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878fa06-4e66-45de-a632-a9fa7c1542a3 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:43.853519 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878fa06-4e66-45de-a632-a9fa7c1542a3 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:43.859068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e76696-4b4a-41a5-bb3a-3740fcfe8d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:43.859947 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76696-4b4a-41a5-bb3a-3740fcfe8d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.860222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76696-4b4a-41a5-bb3a-3740fcfe8d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.860492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76696-4b4a-41a5-bb3a-3740fcfe8d29 admin admin] PATH_INFO: `/v3/projects/31b22b114a1243cc92a14bc63144ea25/users/9a8417db522b4c669cf36cf65cf985c3/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.875858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e76696-4b4a-41a5-bb3a-3740fcfe8d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b22b114a1243cc92a14bc63144ea25, user_id=9a8417db522b4c669cf36cf65cf985c3, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:43.878898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e76696-4b4a-41a5-bb3a-3740fcfe8d29 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:43.895051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1274/2523] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:43 2022] PUT /identity/v3/projects/31b22b114a1243cc92a14bc63144ea25/users/9a8417db522b4c669cf36cf65cf985c3/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:43.906482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be6d81-9b19-42d0-b326-10d11a1ffa99 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.906758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be6d81-9b19-42d0-b326-10d11a1ffa99 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.907038 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be6d81-9b19-42d0-b326-10d11a1ffa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.934212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f4be6d81-9b19-42d0-b326-10d11a1ffa99 None None] MFA Rules not processed for user `9a8417db522b4c669cf36cf65cf985c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:43.935405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f4be6d81-9b19-42d0-b326-10d11a1ffa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.007941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1250/2524] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:44.019790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e76696-4b4a-41a5-bb3a-3740fcfe8d29 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:44.021817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-57e76696-4b4a-41a5-bb3a-3740fcfe8d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.081525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e76696-4b4a-41a5-bb3a-3740fcfe8d29 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:44.085608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2b989-9362-4016-bb09-9c4a3b653a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:44.086278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2b989-9362-4016-bb09-9c4a3b653a0a service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.086562 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2b989-9362-4016-bb09-9c4a3b653a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.086826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2b989-9362-4016-bb09-9c4a3b653a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.095395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2b989-9362-4016-bb09-9c4a3b653a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:44.096824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2b989-9362-4016-bb09-9c4a3b653a0a service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:44.105616 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1275/2525] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:44.125713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be6d81-9b19-42d0-b326-10d11a1ffa99 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:44.191637 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be6d81-9b19-42d0-b326-10d11a1ffa99 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:44.197260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:44.198131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.198447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.198724 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] PATH_INFO: `/v3/users/9a8417db522b4c669cf36cf65cf985c3` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.199956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8417db522b4c669cf36cf65cf985c3)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:44.201883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:44.249050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8417db522b4c669cf36cf65cf985c3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.260824 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8417db522b4c669cf36cf65cf985c3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.261542 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8417db522b4c669cf36cf65cf985c3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.270158 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8417db522b4c669cf36cf65cf985c3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.270851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8417db522b4c669cf36cf65cf985c3'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.283163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1251/2526] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:44 2022] DELETE /identity/v3/users/9a8417db522b4c669cf36cf65cf985c3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:44.288048 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a2ea-df30-4978-90a5-81663c0e8eff None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.288350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a2ea-df30-4978-90a5-81663c0e8eff None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.288610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a2ea-df30-4978-90a5-81663c0e8eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.306829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-51a3a2ea-df30-4978-90a5-81663c0e8eff None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:44.308068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-51a3a2ea-df30-4978-90a5-81663c0e8eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.372595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1276/2527] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:44.383843 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:44.385500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.444735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd01c-a8fa-4057-84f4-dd0facc02e67 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:44.448923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc73226-772c-4c42-9007-3b821c6d3298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:44.449567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc73226-772c-4c42-9007-3b821c6d3298 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.449851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc73226-772c-4c42-9007-3b821c6d3298 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.450110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc73226-772c-4c42-9007-3b821c6d3298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.459898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc73226-772c-4c42-9007-3b821c6d3298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:44.461343 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc73226-772c-4c42-9007-3b821c6d3298 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:44.470935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1252/2528] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:44.754698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3a2ea-df30-4978-90a5-81663c0e8eff None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:44.756182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-51a3a2ea-df30-4978-90a5-81663c0e8eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.775473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3a2ea-df30-4978-90a5-81663c0e8eff None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:44.780393 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:44.781280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.781559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.781830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] PATH_INFO: `/v3/projects/31b22b114a1243cc92a14bc63144ea25` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.783137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b22b114a1243cc92a14bc63144ea25)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:44.785037 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:44.836092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b22b114a1243cc92a14bc63144ea25', 'request_id': 'req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.843695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b22b114a1243cc92a14bc63144ea25', 'request_id': 'req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.853840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b22b114a1243cc92a14bc63144ea25', 'request_id': 'req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.869374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] The token cache is being invalidate because project 31b22b114a1243cc92a14bc63144ea25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:44.869663 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.870636 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.872718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1277/2529] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:44 2022] DELETE /identity/v3/projects/31b22b114a1243cc92a14bc63144ea25 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:57:44.877633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532aed7-c099-4646-87d6-3f04afeb0861 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.877833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532aed7-c099-4646-87d6-3f04afeb0861 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.878136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532aed7-c099-4646-87d6-3f04afeb0861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.900679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-6532aed7-c099-4646-87d6-3f04afeb0861 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:44.902004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6532aed7-c099-4646-87d6-3f04afeb0861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.955975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:44.958398 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.978681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1253/2530] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:44.988682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be745c-b96b-463d-9740-149df56e8df6 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.989055 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be745c-b96b-463d-9740-149df56e8df6 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.989223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be745c-b96b-463d-9740-149df56e8df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.012326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-71be745c-b96b-463d-9740-149df56e8df6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:45.014560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-71be745c-b96b-463d-9740-149df56e8df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:45.028424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1254/2531] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:45.032652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be745c-b96b-463d-9740-149df56e8df6 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:45.046924 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be745c-b96b-463d-9740-149df56e8df6 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.055085 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f1eba-23cb-45c2-baa8-fdd26a5f8e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.056029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f1eba-23cb-45c2-baa8-fdd26a5f8e80 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.057141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f1eba-23cb-45c2-baa8-fdd26a5f8e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.057141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f1eba-23cb-45c2-baa8-fdd26a5f8e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.058126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f1eba-23cb-45c2-baa8-fdd26a5f8e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:45.058677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f1eba-23cb-45c2-baa8-fdd26a5f8e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.061052 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f1eba-23cb-45c2-baa8-fdd26a5f8e80 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.075293 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1255/2532] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:45.076632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ac86c-eec9-4d58-9e95-4d4bb01b929f admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.079526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f1eba-23cb-45c2-baa8-fdd26a5f8e80 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:45.083103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f953d31-c165-44b3-a9b4-a77ea984dcdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.084000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f953d31-c165-44b3-a9b4-a77ea984dcdd service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.084525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f953d31-c165-44b3-a9b4-a77ea984dcdd service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.085034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f953d31-c165-44b3-a9b4-a77ea984dcdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.087124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-5f953d31-c165-44b3-a9b4-a77ea984dcdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:45.089359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f1eba-23cb-45c2-baa8-fdd26a5f8e80 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.094649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee11d1-204b-49f3-b2d3-df4cf67dad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.095469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee11d1-204b-49f3-b2d3-df4cf67dad66 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.095755 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee11d1-204b-49f3-b2d3-df4cf67dad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.096114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee11d1-204b-49f3-b2d3-df4cf67dad66 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.096813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee11d1-204b-49f3-b2d3-df4cf67dad66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.098782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee11d1-204b-49f3-b2d3-df4cf67dad66 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.130579 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1256/2533] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:45 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:57:45.132171 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee11d1-204b-49f3-b2d3-df4cf67dad66 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:45.148814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f953d31-c165-44b3-a9b4-a77ea984dcdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.150532 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f953d31-c165-44b3-a9b4-a77ea984dcdd service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.159673 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1278/2534] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:57:45.192695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee11d1-204b-49f3-b2d3-df4cf67dad66 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.198046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d405d50-84d7-4c37-a7f9-83aeca601d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.198958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d405d50-84d7-4c37-a7f9-83aeca601d22 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.199283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d405d50-84d7-4c37-a7f9-83aeca601d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.199560 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d405d50-84d7-4c37-a7f9-83aeca601d22 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.200245 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d405d50-84d7-4c37-a7f9-83aeca601d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.202223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d405d50-84d7-4c37-a7f9-83aeca601d22 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.226346 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1257/2535] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:45 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:57:45.227566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f953d31-c165-44b3-a9b4-a77ea984dcdd service nova] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:45.237824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f953d31-c165-44b3-a9b4-a77ea984dcdd service nova] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.242646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0271a7-e74e-4943-a30e-c250d9c54870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.243327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0271a7-e74e-4943-a30e-c250d9c54870 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.243608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0271a7-e74e-4943-a30e-c250d9c54870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.243880 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0271a7-e74e-4943-a30e-c250d9c54870 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.244632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0271a7-e74e-4943-a30e-c250d9c54870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.246257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0271a7-e74e-4943-a30e-c250d9c54870 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.259176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1279/2536] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:45.260372 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d405d50-84d7-4c37-a7f9-83aeca601d22 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:45.270586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d405d50-84d7-4c37-a7f9-83aeca601d22 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.275422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c43fbe-79f5-4256-ac99-9284210ecfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.276113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c43fbe-79f5-4256-ac99-9284210ecfce admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.276419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c43fbe-79f5-4256-ac99-9284210ecfce admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.276692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c43fbe-79f5-4256-ac99-9284210ecfce admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.277454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c43fbe-79f5-4256-ac99-9284210ecfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.279153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c43fbe-79f5-4256-ac99-9284210ecfce admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.289313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1258/2537] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:45.294145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0271a7-e74e-4943-a30e-c250d9c54870 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:45.304287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0271a7-e74e-4943-a30e-c250d9c54870 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.309695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d919b2c-e65b-48f1-8b19-e7cb4aa042a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.310657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d919b2c-e65b-48f1-8b19-e7cb4aa042a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.310944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d919b2c-e65b-48f1-8b19-e7cb4aa042a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.311217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d919b2c-e65b-48f1-8b19-e7cb4aa042a6 admin admin] PATH_INFO: `/v3/projects/b882678c9eef405380051c9bbdfeaf76/users/ae1ec3726f3d413cbb67f96ed9cfc404/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.327368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d919b2c-e65b-48f1-8b19-e7cb4aa042a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b882678c9eef405380051c9bbdfeaf76, user_id=ae1ec3726f3d413cbb67f96ed9cfc404, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.330455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d919b2c-e65b-48f1-8b19-e7cb4aa042a6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.344915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1280/2538] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:45 2022] PUT /identity/v3/projects/b882678c9eef405380051c9bbdfeaf76/users/ae1ec3726f3d413cbb67f96ed9cfc404/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:57:45.356325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912a3c1-a2da-4721-84ab-3f66928730dc None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.356610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912a3c1-a2da-4721-84ab-3f66928730dc None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.356950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912a3c1-a2da-4721-84ab-3f66928730dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.384452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-4912a3c1-a2da-4721-84ab-3f66928730dc None None] MFA Rules not processed for user `ae1ec3726f3d413cbb67f96ed9cfc404`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:45.386188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4912a3c1-a2da-4721-84ab-3f66928730dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:45.463058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1259/2539] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:45.474453 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d919b2c-e65b-48f1-8b19-e7cb4aa042a6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:45.476677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7d919b2c-e65b-48f1-8b19-e7cb4aa042a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:45.533500 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d919b2c-e65b-48f1-8b19-e7cb4aa042a6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.537241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb92c3-0296-48fd-8413-4223bdf741e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.537927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb92c3-0296-48fd-8413-4223bdf741e5 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.538237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb92c3-0296-48fd-8413-4223bdf741e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.538513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb92c3-0296-48fd-8413-4223bdf741e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.547756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb92c3-0296-48fd-8413-4223bdf741e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.549203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb92c3-0296-48fd-8413-4223bdf741e5 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.558052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1281/2540] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:52.880084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ece5f-2c10-4c67-9e3b-f53ff6a931c1 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:52.880640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ece5f-2c10-4c67-9e3b-f53ff6a931c1 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:52.880640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ece5f-2c10-4c67-9e3b-f53ff6a931c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:52.898626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1c0ece5f-2c10-4c67-9e3b-f53ff6a931c1 None None] MFA Rules not processed for user `cfa08e94c62b458ca5aa23a53d30f817`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:52.899826 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1c0ece5f-2c10-4c67-9e3b-f53ff6a931c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:52.961594 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1260/2541] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:53.014808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb92c3-0296-48fd-8413-4223bdf741e5 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:53.079627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb92c3-0296-48fd-8413-4223bdf741e5 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:53.084224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:53.085102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.085386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.085689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] PATH_INFO: `/v3/users/ae1ec3726f3d413cbb67f96ed9cfc404` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.086931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1ec3726f3d413cbb67f96ed9cfc404)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:53.088907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:53.135438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1ec3726f3d413cbb67f96ed9cfc404'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:53.147776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1ec3726f3d413cbb67f96ed9cfc404'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:53.148483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1ec3726f3d413cbb67f96ed9cfc404'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:53.149093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1ec3726f3d413cbb67f96ed9cfc404'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:53.159986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1ec3726f3d413cbb67f96ed9cfc404'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:53.173302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1282/2542] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:53 2022] DELETE /identity/v3/users/ae1ec3726f3d413cbb67f96ed9cfc404 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:53.177975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ce7e0-1cc5-428b-94f9-aab600708d62 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.178301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ce7e0-1cc5-428b-94f9-aab600708d62 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.178567 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ce7e0-1cc5-428b-94f9-aab600708d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.196370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-2e9ce7e0-1cc5-428b-94f9-aab600708d62 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:53.197696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2e9ce7e0-1cc5-428b-94f9-aab600708d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.256538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1261/2543] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:57:53.265812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:53.267535 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.274250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ce7e0-1cc5-428b-94f9-aab600708d62 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:53.275654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-2e9ce7e0-1cc5-428b-94f9-aab600708d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.324033 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369f138-08ef-4282-9885-375084b3811c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:53.327990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138aa237-53cf-4eca-b48f-711b25a9cf53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:53.328631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aa237-53cf-4eca-b48f-711b25a9cf53 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.328905 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aa237-53cf-4eca-b48f-711b25a9cf53 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.329172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aa237-53cf-4eca-b48f-711b25a9cf53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.330041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ce7e0-1cc5-428b-94f9-aab600708d62 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:53.333604 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5055a-84dc-44fd-8173-2579da5935c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:53.334279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5055a-84dc-44fd-8173-2579da5935c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.334559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5055a-84dc-44fd-8173-2579da5935c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.334828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5055a-84dc-44fd-8173-2579da5935c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.336598 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4da5055a-84dc-44fd-8173-2579da5935c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.338172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138aa237-53cf-4eca-b48f-711b25a9cf53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:53.339629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138aa237-53cf-4eca-b48f-711b25a9cf53 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:53.346252 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5055a-84dc-44fd-8173-2579da5935c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:53.347691 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5055a-84dc-44fd-8173-2579da5935c1 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:53.348929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1283/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:53.356141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1262/2545] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:57:53.776125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138aa237-53cf-4eca-b48f-711b25a9cf53 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:53.777967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-138aa237-53cf-4eca-b48f-711b25a9cf53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.781269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5055a-84dc-44fd-8173-2579da5935c1 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:53.782710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4da5055a-84dc-44fd-8173-2579da5935c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.798751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138aa237-53cf-4eca-b48f-711b25a9cf53 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:53.804340 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:53.807289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.807539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.807812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] PATH_INFO: `/v3/projects/b882678c9eef405380051c9bbdfeaf76` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.815137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b882678c9eef405380051c9bbdfeaf76)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:53.817698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:53.871657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5055a-84dc-44fd-8173-2579da5935c1 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:53.880321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b882678c9eef405380051c9bbdfeaf76', 'request_id': 'req-a6751153-3c5b-4569-9cc5-8475db48df2c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:53.886588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b882678c9eef405380051c9bbdfeaf76', 'request_id': 'req-a6751153-3c5b-4569-9cc5-8475db48df2c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:53.894498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b882678c9eef405380051c9bbdfeaf76', 'request_id': 'req-a6751153-3c5b-4569-9cc5-8475db48df2c'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:53.904651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] The token cache is being invalidate because project b882678c9eef405380051c9bbdfeaf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:53.905050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:53.905772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a6751153-3c5b-4569-9cc5-8475db48df2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:53.907333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1284/2546] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:53 2022] DELETE /identity/v3/projects/b882678c9eef405380051c9bbdfeaf76 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:53.912105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10596f01-465b-4076-8f6f-321d8749f716 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.912369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10596f01-465b-4076-8f6f-321d8749f716 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.912646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10596f01-465b-4076-8f6f-321d8749f716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.930494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-10596f01-465b-4076-8f6f-321d8749f716 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:53.931102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52672044-34a4-4449-8520-70aec3eb8bf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:53.931758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-10596f01-465b-4076-8f6f-321d8749f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.931881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52672044-34a4-4449-8520-70aec3eb8bf1 service placement] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.932170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52672044-34a4-4449-8520-70aec3eb8bf1 service placement] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.932443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52672044-34a4-4449-8520-70aec3eb8bf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.934202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-52672044-34a4-4449-8520-70aec3eb8bf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.945248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52672044-34a4-4449-8520-70aec3eb8bf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:53.946796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52672044-34a4-4449-8520-70aec3eb8bf1 service placement] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:53.956422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1263/2547] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:57:53.991253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1285/2548] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:57:53.999581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0205-03d5-43fa-9d34-91c37b15b920 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.999868 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0205-03d5-43fa-9d34-91c37b15b920 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.000141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0205-03d5-43fa-9d34-91c37b15b920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.018533 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-693d0205-03d5-43fa-9d34-91c37b15b920 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:54.019805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-693d0205-03d5-43fa-9d34-91c37b15b920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:54.028422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1264/2549] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:54.032721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10596f01-465b-4076-8f6f-321d8749f716 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.043217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10596f01-465b-4076-8f6f-321d8749f716 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.048014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5922a0b-73f4-493c-9fb8-e79a61cb570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.048677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5922a0b-73f4-493c-9fb8-e79a61cb570e admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.048958 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5922a0b-73f4-493c-9fb8-e79a61cb570e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.049266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5922a0b-73f4-493c-9fb8-e79a61cb570e admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.049963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5922a0b-73f4-493c-9fb8-e79a61cb570e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:54.050302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5922a0b-73f4-493c-9fb8-e79a61cb570e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.052018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5922a0b-73f4-493c-9fb8-e79a61cb570e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.064082 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1286/2550] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:57:54.068228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d0205-03d5-43fa-9d34-91c37b15b920 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.077949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d0205-03d5-43fa-9d34-91c37b15b920 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.083752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34ee54-7836-4a2d-9224-ec4af513f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.084408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34ee54-7836-4a2d-9224-ec4af513f6dd admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.084703 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34ee54-7836-4a2d-9224-ec4af513f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.084972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34ee54-7836-4a2d-9224-ec4af513f6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.085675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34ee54-7836-4a2d-9224-ec4af513f6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.087610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34ee54-7836-4a2d-9224-ec4af513f6dd admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.115177 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1265/2551] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:54 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:54.119333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5922a0b-73f4-493c-9fb8-e79a61cb570e admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.130056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5922a0b-73f4-493c-9fb8-e79a61cb570e admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.187020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86178e6-7dd2-48f6-93cd-f64dc5a0e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.187705 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86178e6-7dd2-48f6-93cd-f64dc5a0e9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.187990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86178e6-7dd2-48f6-93cd-f64dc5a0e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.188261 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86178e6-7dd2-48f6-93cd-f64dc5a0e9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.188975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86178e6-7dd2-48f6-93cd-f64dc5a0e9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.190945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86178e6-7dd2-48f6-93cd-f64dc5a0e9a9 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.212305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1287/2552] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:54 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:57:54.216329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34ee54-7836-4a2d-9224-ec4af513f6dd admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.226400 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34ee54-7836-4a2d-9224-ec4af513f6dd admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.231345 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63e7ba-2035-4213-896c-fcc3228b2a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.232019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63e7ba-2035-4213-896c-fcc3228b2a03 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.232303 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63e7ba-2035-4213-896c-fcc3228b2a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.232610 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63e7ba-2035-4213-896c-fcc3228b2a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.233297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63e7ba-2035-4213-896c-fcc3228b2a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.234948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63e7ba-2035-4213-896c-fcc3228b2a03 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.247048 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1266/2553] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:54.251452 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86178e6-7dd2-48f6-93cd-f64dc5a0e9a9 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.261938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86178e6-7dd2-48f6-93cd-f64dc5a0e9a9 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.266739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d95263-70ab-463d-84c7-b2345c936ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.267463 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d95263-70ab-463d-84c7-b2345c936ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.267797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d95263-70ab-463d-84c7-b2345c936ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.268142 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d95263-70ab-463d-84c7-b2345c936ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.268963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d95263-70ab-463d-84c7-b2345c936ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.270736 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d95263-70ab-463d-84c7-b2345c936ba8 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.282788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1288/2554] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:54.287220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63e7ba-2035-4213-896c-fcc3228b2a03 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.298028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63e7ba-2035-4213-896c-fcc3228b2a03 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.302890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d78bc-71f8-43fc-84e0-e41bb8645a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.304005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d78bc-71f8-43fc-84e0-e41bb8645a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.304278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d78bc-71f8-43fc-84e0-e41bb8645a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.304554 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d78bc-71f8-43fc-84e0-e41bb8645a04 admin admin] PATH_INFO: `/v3/projects/539141afeb5248239303eee9a15136c5/users/78b64f0289154a0fb83d7f74e385c11e/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.320580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d78bc-71f8-43fc-84e0-e41bb8645a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539141afeb5248239303eee9a15136c5, user_id=78b64f0289154a0fb83d7f74e385c11e, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.323452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d78bc-71f8-43fc-84e0-e41bb8645a04 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.337801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1267/2555] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:54 2022] PUT /identity/v3/projects/539141afeb5248239303eee9a15136c5/users/78b64f0289154a0fb83d7f74e385c11e/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:54.348745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d9f06-0e40-40de-b7b3-4c4ea1f45331 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.349035 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d9f06-0e40-40de-b7b3-4c4ea1f45331 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.349313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d9f06-0e40-40de-b7b3-4c4ea1f45331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.375629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b80d9f06-0e40-40de-b7b3-4c4ea1f45331 None None] MFA Rules not processed for user `78b64f0289154a0fb83d7f74e385c11e`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:54.376845 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b80d9f06-0e40-40de-b7b3-4c4ea1f45331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:54.440655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1289/2556] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:57:54.445188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d78bc-71f8-43fc-84e0-e41bb8645a04 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.506242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d78bc-71f8-43fc-84e0-e41bb8645a04 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.511482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46569b-68ff-4ed7-89df-371a54aafaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.512138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46569b-68ff-4ed7-89df-371a54aafaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.512412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46569b-68ff-4ed7-89df-371a54aafaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.512677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46569b-68ff-4ed7-89df-371a54aafaa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.513464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46569b-68ff-4ed7-89df-371a54aafaa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.515385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46569b-68ff-4ed7-89df-371a54aafaa9 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.542738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1268/2557] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:54 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:54.547012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d9f06-0e40-40de-b7b3-4c4ea1f45331 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.558005 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d9f06-0e40-40de-b7b3-4c4ea1f45331 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.618853 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9760a86-034d-4ea7-a9b3-5dd549b9b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.619635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9760a86-034d-4ea7-a9b3-5dd549b9b8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.619931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9760a86-034d-4ea7-a9b3-5dd549b9b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.620167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9760a86-034d-4ea7-a9b3-5dd549b9b8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.620873 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9760a86-034d-4ea7-a9b3-5dd549b9b8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.622865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9760a86-034d-4ea7-a9b3-5dd549b9b8b0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.644717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1290/2558] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:54 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:57:54.648771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46569b-68ff-4ed7-89df-371a54aafaa9 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.659614 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46569b-68ff-4ed7-89df-371a54aafaa9 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.664415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17e1ce-184d-4bad-a379-7fb3ca173da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.665458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e1ce-184d-4bad-a379-7fb3ca173da4 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.665739 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e1ce-184d-4bad-a379-7fb3ca173da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.666014 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e1ce-184d-4bad-a379-7fb3ca173da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.666778 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17e1ce-184d-4bad-a379-7fb3ca173da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.668419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17e1ce-184d-4bad-a379-7fb3ca173da4 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.679249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1269/2559] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:54.683932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9760a86-034d-4ea7-a9b3-5dd549b9b8b0 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.695103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9760a86-034d-4ea7-a9b3-5dd549b9b8b0 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.700239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12764e3a-7886-4a15-886e-4d51b3676d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.701000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764e3a-7886-4a15-886e-4d51b3676d67 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.701317 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764e3a-7886-4a15-886e-4d51b3676d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.701627 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764e3a-7886-4a15-886e-4d51b3676d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.702647 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12764e3a-7886-4a15-886e-4d51b3676d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.704631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12764e3a-7886-4a15-886e-4d51b3676d67 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.714977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1291/2560] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:54.719176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17e1ce-184d-4bad-a379-7fb3ca173da4 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.729408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17e1ce-184d-4bad-a379-7fb3ca173da4 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.734551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795586fd-6c97-4d5d-9466-1ea22b19d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.735490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795586fd-6c97-4d5d-9466-1ea22b19d3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.735838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795586fd-6c97-4d5d-9466-1ea22b19d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.736180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795586fd-6c97-4d5d-9466-1ea22b19d3c5 admin admin] PATH_INFO: `/v3/projects/27ebb3114dc949f0967cdb8d2a7e277f/users/119a10ac7f624935bdb1beb572a4218f/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.751134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795586fd-6c97-4d5d-9466-1ea22b19d3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ebb3114dc949f0967cdb8d2a7e277f, user_id=119a10ac7f624935bdb1beb572a4218f, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.753869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795586fd-6c97-4d5d-9466-1ea22b19d3c5 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.786204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1270/2561] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:54 2022] PUT /identity/v3/projects/27ebb3114dc949f0967cdb8d2a7e277f/users/119a10ac7f624935bdb1beb572a4218f/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:54.786367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9dbe-ce09-4d68-b0c2-4af5f8c53788 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.786367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9dbe-ce09-4d68-b0c2-4af5f8c53788 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.786367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd9dbe-ce09-4d68-b0c2-4af5f8c53788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.810247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-0ffd9dbe-ce09-4d68-b0c2-4af5f8c53788 None None] MFA Rules not processed for user `119a10ac7f624935bdb1beb572a4218f`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:54.811464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0ffd9dbe-ce09-4d68-b0c2-4af5f8c53788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:54.877825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1292/2562] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:54.882348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795586fd-6c97-4d5d-9466-1ea22b19d3c5 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.953846 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795586fd-6c97-4d5d-9466-1ea22b19d3c5 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.959585 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a322-a313-44a9-83f8-f7f8a2d2ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.960269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a322-a313-44a9-83f8-f7f8a2d2ae95 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.960544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a322-a313-44a9-83f8-f7f8a2d2ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.960819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a322-a313-44a9-83f8-f7f8a2d2ae95 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.962453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76a322-a313-44a9-83f8-f7f8a2d2ae95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.965340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76a322-a313-44a9-83f8-f7f8a2d2ae95 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.003440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1271/2563] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:54 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:57:55.007560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9dbe-ce09-4d68-b0c2-4af5f8c53788 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.018096 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd9dbe-ce09-4d68-b0c2-4af5f8c53788 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.073804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1473f3-ea49-4db0-98ed-1c7233ecd2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.074533 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1473f3-ea49-4db0-98ed-1c7233ecd2ca admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.074814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1473f3-ea49-4db0-98ed-1c7233ecd2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.075087 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1473f3-ea49-4db0-98ed-1c7233ecd2ca admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.075795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1473f3-ea49-4db0-98ed-1c7233ecd2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.077722 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1473f3-ea49-4db0-98ed-1c7233ecd2ca admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.098576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1293/2564] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:55 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:55.102606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a322-a313-44a9-83f8-f7f8a2d2ae95 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.112688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a322-a313-44a9-83f8-f7f8a2d2ae95 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.117577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813177-7f02-4847-b61e-17f90e27df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.118357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813177-7f02-4847-b61e-17f90e27df1c admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.118642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813177-7f02-4847-b61e-17f90e27df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.118968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813177-7f02-4847-b61e-17f90e27df1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.119678 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d813177-7f02-4847-b61e-17f90e27df1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.121303 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d813177-7f02-4847-b61e-17f90e27df1c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.132145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1272/2565] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:55.136504 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1473f3-ea49-4db0-98ed-1c7233ecd2ca admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.146586 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1473f3-ea49-4db0-98ed-1c7233ecd2ca admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.151513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f1c84-6d16-4f3f-bba5-87b2e0179914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.152423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1c84-6d16-4f3f-bba5-87b2e0179914 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.152703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1c84-6d16-4f3f-bba5-87b2e0179914 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.152959 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1c84-6d16-4f3f-bba5-87b2e0179914 admin admin] PATH_INFO: `/v3/projects/b365d9fb4023497f86c5df6ed140fa66/users/bc49696bf6fa4e8497d51f326de0475d/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.168489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f1c84-6d16-4f3f-bba5-87b2e0179914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b365d9fb4023497f86c5df6ed140fa66, user_id=bc49696bf6fa4e8497d51f326de0475d, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.171372 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f1c84-6d16-4f3f-bba5-87b2e0179914 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.185569 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1294/2566] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:55 2022] PUT /identity/v3/projects/b365d9fb4023497f86c5df6ed140fa66/users/bc49696bf6fa4e8497d51f326de0475d/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:55.189851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813177-7f02-4847-b61e-17f90e27df1c admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.200285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813177-7f02-4847-b61e-17f90e27df1c admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.255607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679901b5-c910-4b5c-8e2c-d94165e88cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.256285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679901b5-c910-4b5c-8e2c-d94165e88cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.256572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679901b5-c910-4b5c-8e2c-d94165e88cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.256848 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679901b5-c910-4b5c-8e2c-d94165e88cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.257606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679901b5-c910-4b5c-8e2c-d94165e88cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.259289 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679901b5-c910-4b5c-8e2c-d94165e88cb9 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.272685 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1273/2567] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:55.273824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f1c84-6d16-4f3f-bba5-87b2e0179914 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.285108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f1c84-6d16-4f3f-bba5-87b2e0179914 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.290954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301dc3-0c50-408c-a266-f8f0b1685528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.291849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301dc3-0c50-408c-a266-f8f0b1685528 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.292129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301dc3-0c50-408c-a266-f8f0b1685528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.292403 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301dc3-0c50-408c-a266-f8f0b1685528 admin admin] PATH_INFO: `/v3/projects/b365d9fb4023497f86c5df6ed140fa66/users/bc49696bf6fa4e8497d51f326de0475d/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.294766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6301dc3-0c50-408c-a266-f8f0b1685528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b365d9fb4023497f86c5df6ed140fa66, user_id=bc49696bf6fa4e8497d51f326de0475d, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.297951 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6301dc3-0c50-408c-a266-f8f0b1685528 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.308858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1295/2568] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:55 2022] PUT /identity/v3/projects/b365d9fb4023497f86c5df6ed140fa66/users/bc49696bf6fa4e8497d51f326de0475d/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:55.319287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d1ec9-90b3-405c-a718-4ccc1e786da5 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.319581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d1ec9-90b3-405c-a718-4ccc1e786da5 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.319864 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d1ec9-90b3-405c-a718-4ccc1e786da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.346329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c98d1ec9-90b3-405c-a718-4ccc1e786da5 None None] MFA Rules not processed for user `bc49696bf6fa4e8497d51f326de0475d`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:55.347548 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c98d1ec9-90b3-405c-a718-4ccc1e786da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:55.417179 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1274/2569] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:55.429235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301dc3-0c50-408c-a266-f8f0b1685528 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.431151 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f6301dc3-0c50-408c-a266-f8f0b1685528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:55.492561 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301dc3-0c50-408c-a266-f8f0b1685528 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.496760 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d6672-f494-4549-aa5b-93c807cafbc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.497428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6672-f494-4549-aa5b-93c807cafbc2 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.497698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6672-f494-4549-aa5b-93c807cafbc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.497978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6672-f494-4549-aa5b-93c807cafbc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.558657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d6672-f494-4549-aa5b-93c807cafbc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.560029 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d6672-f494-4549-aa5b-93c807cafbc2 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.569761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1296/2570] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:55.856204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d1ec9-90b3-405c-a718-4ccc1e786da5 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.857989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c98d1ec9-90b3-405c-a718-4ccc1e786da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:55.956075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d1ec9-90b3-405c-a718-4ccc1e786da5 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.959745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447fc9-8333-49e9-96ec-1d29c45fec0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.960621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447fc9-8333-49e9-96ec-1d29c45fec0b service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.960915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447fc9-8333-49e9-96ec-1d29c45fec0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.961185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447fc9-8333-49e9-96ec-1d29c45fec0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.963746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-fd447fc9-8333-49e9-96ec-1d29c45fec0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:55.976979 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd447fc9-8333-49e9-96ec-1d29c45fec0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.978547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd447fc9-8333-49e9-96ec-1d29c45fec0b service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.987353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1275/2571] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:57.119156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d6672-f494-4549-aa5b-93c807cafbc2 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:57.121161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-381d6672-f494-4549-aa5b-93c807cafbc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:57.132105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d6672-f494-4549-aa5b-93c807cafbc2 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:57.135860 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577252-fef4-47d1-be1a-42637347eff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:57.136500 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577252-fef4-47d1-be1a-42637347eff7 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:57.136772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577252-fef4-47d1-be1a-42637347eff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:57.137041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577252-fef4-47d1-be1a-42637347eff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:57.197721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd577252-fef4-47d1-be1a-42637347eff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:57.199418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd577252-fef4-47d1-be1a-42637347eff7 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:57.208561 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1297/2572] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:57.768332 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447fc9-8333-49e9-96ec-1d29c45fec0b service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:57.779143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447fc9-8333-49e9-96ec-1d29c45fec0b service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:57.782951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aec99e-1517-4734-bab8-0a5af504f82a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:57.783601 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aec99e-1517-4734-bab8-0a5af504f82a service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:57.783941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aec99e-1517-4734-bab8-0a5af504f82a service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:57.784443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aec99e-1517-4734-bab8-0a5af504f82a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:57.794331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aec99e-1517-4734-bab8-0a5af504f82a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:57.795775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aec99e-1517-4734-bab8-0a5af504f82a service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:57.805393 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1276/2573] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:01.724210 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577252-fef4-47d1-be1a-42637347eff7 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:01.788105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577252-fef4-47d1-be1a-42637347eff7 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:01.794367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:01.795244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:01.795520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:01.795790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] PATH_INFO: `/v3/users/78b64f0289154a0fb83d7f74e385c11e` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:01.797200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b64f0289154a0fb83d7f74e385c11e)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:01.799189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:01.859271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b64f0289154a0fb83d7f74e385c11e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:01.874174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b64f0289154a0fb83d7f74e385c11e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:01.874848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b64f0289154a0fb83d7f74e385c11e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:01.876016 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b64f0289154a0fb83d7f74e385c11e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:01.883669 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b64f0289154a0fb83d7f74e385c11e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:01.896173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1298/2574] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:01 2022] DELETE /identity/v3/users/78b64f0289154a0fb83d7f74e385c11e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:01.900962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce6004-874d-41a6-af8c-97b7cda35299 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:01.901442 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce6004-874d-41a6-af8c-97b7cda35299 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:01.901537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce6004-874d-41a6-af8c-97b7cda35299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:01.922432 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-28ce6004-874d-41a6-af8c-97b7cda35299 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:01.923665 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-28ce6004-874d-41a6-af8c-97b7cda35299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:01.989458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1277/2575] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:01.996968 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:01.998502 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:02.076541 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e1f6-20f0-4b87-8747-1e6a3f147f67 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:02.080724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1c88-04ef-4ba0-8885-487ce790ea53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:02.081418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1c88-04ef-4ba0-8885-487ce790ea53 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:02.081725 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1c88-04ef-4ba0-8885-487ce790ea53 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:02.081999 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1c88-04ef-4ba0-8885-487ce790ea53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:02.094630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab1c88-04ef-4ba0-8885-487ce790ea53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:02.096234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab1c88-04ef-4ba0-8885-487ce790ea53 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:02.107166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1299/2576] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:02.405876 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b70779-3acd-419c-a396-4e84f46a6a68 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:02.406553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b70779-3acd-419c-a396-4e84f46a6a68 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:02.407051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b70779-3acd-419c-a396-4e84f46a6a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:02.467232 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-03b70779-3acd-419c-a396-4e84f46a6a68 None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:02.468639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-03b70779-3acd-419c-a396-4e84f46a6a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:02.536110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1c88-04ef-4ba0-8885-487ce790ea53 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:02.537867 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-58ab1c88-04ef-4ba0-8885-487ce790ea53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:02.550314 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1278/2577] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:58:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:02.555280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1c88-04ef-4ba0-8885-487ce790ea53 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:02.561289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:02.562635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:02.562961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:02.563235 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] PATH_INFO: `/v3/projects/539141afeb5248239303eee9a15136c5` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:02.564472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539141afeb5248239303eee9a15136c5)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:02.566443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:02.615681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b70779-3acd-419c-a396-4e84f46a6a68 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:02.617078 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-03b70779-3acd-419c-a396-4e84f46a6a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:02.626787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539141afeb5248239303eee9a15136c5', 'request_id': 'req-d14ba669-d038-485e-926e-df8bcd6897e9'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:02.632717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539141afeb5248239303eee9a15136c5', 'request_id': 'req-d14ba669-d038-485e-926e-df8bcd6897e9'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:02.648041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539141afeb5248239303eee9a15136c5', 'request_id': 'req-d14ba669-d038-485e-926e-df8bcd6897e9'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:02.659423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] The token cache is being invalidate because project 539141afeb5248239303eee9a15136c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:02.659698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:02.660323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:02.662072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1300/2578] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:02 2022] DELETE /identity/v3/projects/539141afeb5248239303eee9a15136c5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:02.666038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:02.667401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:02.707618 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b70779-3acd-419c-a396-4e84f46a6a68 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:02.729546 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ba669-d038-485e-926e-df8bcd6897e9 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:02.734382 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:02.735274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:02.735556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:02.735853 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] PATH_INFO: `/v3/users/119a10ac7f624935bdb1beb572a4218f` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:02.737058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=119a10ac7f624935bdb1beb572a4218f)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:02.739047 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:02.768241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0be13f-e71c-48bd-bd28-744927b36106 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:02.769187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0be13f-e71c-48bd-bd28-744927b36106 service swift] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:02.769469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0be13f-e71c-48bd-bd28-744927b36106 service swift] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:02.769796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0be13f-e71c-48bd-bd28-744927b36106 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:02.771981 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5d0be13f-e71c-48bd-bd28-744927b36106 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:02.784298 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119a10ac7f624935bdb1beb572a4218f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:02.796259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119a10ac7f624935bdb1beb572a4218f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:02.797074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119a10ac7f624935bdb1beb572a4218f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:02.797605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119a10ac7f624935bdb1beb572a4218f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:02.805662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119a10ac7f624935bdb1beb572a4218f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:02.818129 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1301/2579] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:02 2022] DELETE /identity/v3/users/119a10ac7f624935bdb1beb572a4218f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:02.829321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0be13f-e71c-48bd-bd28-744927b36106 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:02.831044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0be13f-e71c-48bd-bd28-744927b36106 service swift] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:02.839210 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1279/2580] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:58:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 19:58:03.117134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:03.119002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:03.208218 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843f45c-49a8-45af-a260-53eb4d331da3 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:03.215623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:03.216560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:03.216841 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:03.217108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] PATH_INFO: `/v3/projects/27ebb3114dc949f0967cdb8d2a7e277f` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:03.218701 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ebb3114dc949f0967cdb8d2a7e277f)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:03.220670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:03.274854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ebb3114dc949f0967cdb8d2a7e277f', 'request_id': 'req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:03.283621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ebb3114dc949f0967cdb8d2a7e277f', 'request_id': 'req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:03.297724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ebb3114dc949f0967cdb8d2a7e277f', 'request_id': 'req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:03.332121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] The token cache is being invalidate because project 27ebb3114dc949f0967cdb8d2a7e277f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:03.332413 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:03.333304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:03.343812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1302/2581] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:03 2022] DELETE /identity/v3/projects/27ebb3114dc949f0967cdb8d2a7e277f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:03.345364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0be13f-e71c-48bd-bd28-744927b36106 service swift] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:03.360570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0be13f-e71c-48bd-bd28-744927b36106 service swift] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:03.444431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:03.445693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:03.446188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:03.446617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] PATH_INFO: `/v3/users/bc49696bf6fa4e8497d51f326de0475d` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:03.447829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc49696bf6fa4e8497d51f326de0475d)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:03.450213 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:03.513178 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc49696bf6fa4e8497d51f326de0475d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:03.524946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc49696bf6fa4e8497d51f326de0475d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:03.525772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc49696bf6fa4e8497d51f326de0475d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:03.543553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc49696bf6fa4e8497d51f326de0475d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:03.544268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60fe7b03-9b0e-4767-8b5d-78fda3fc7d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc49696bf6fa4e8497d51f326de0475d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:03.564840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1280/2582] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:03 2022] DELETE /identity/v3/users/bc49696bf6fa4e8497d51f326de0475d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:03.913989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:03.915885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:03.953117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f2a93-ebde-4260-b94a-43b3e2c4bdce admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:04.043767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:04.045060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.045060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.045248 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] PATH_INFO: `/v3/projects/b365d9fb4023497f86c5df6ed140fa66` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.046428 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b365d9fb4023497f86c5df6ed140fa66)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:04.048358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:04.104781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b365d9fb4023497f86c5df6ed140fa66', 'request_id': 'req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:04.112654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b365d9fb4023497f86c5df6ed140fa66', 'request_id': 'req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:04.129826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b365d9fb4023497f86c5df6ed140fa66', 'request_id': 'req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:04.147773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] The token cache is being invalidate because project b365d9fb4023497f86c5df6ed140fa66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:04.148524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:04.149676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c1b9fda2-69c9-45cf-ab00-d64d2ce84ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:04.155578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1303/2583] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:03 2022] DELETE /identity/v3/projects/b365d9fb4023497f86c5df6ed140fa66 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:04.158708 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ad3bd-76a2-45e2-9d28-2d6c2e719113 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.159457 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ad3bd-76a2-45e2-9d28-2d6c2e719113 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.160057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ad3bd-76a2-45e2-9d28-2d6c2e719113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.182507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-de2ad3bd-76a2-45e2-9d28-2d6c2e719113 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:04.183873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-de2ad3bd-76a2-45e2-9d28-2d6c2e719113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:04.253454 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1281/2584] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:04.262840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b23991-c997-4859-9fd6-dbdec2df1e68 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.263513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b23991-c997-4859-9fd6-dbdec2df1e68 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.263953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b23991-c997-4859-9fd6-dbdec2df1e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.290316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-a9b23991-c997-4859-9fd6-dbdec2df1e68 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:04.291678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-a9b23991-c997-4859-9fd6-dbdec2df1e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:04.302994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1304/2585] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:04.308220 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ad3bd-76a2-45e2-9d28-2d6c2e719113 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:04.331290 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ad3bd-76a2-45e2-9d28-2d6c2e719113 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:04.336433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dab2c-5c0a-46ca-b519-bf31f699c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:04.337089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dab2c-5c0a-46ca-b519-bf31f699c947 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.337369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dab2c-5c0a-46ca-b519-bf31f699c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.338300 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dab2c-5c0a-46ca-b519-bf31f699c947 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.339044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dab2c-5c0a-46ca-b519-bf31f699c947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:04.339353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dab2c-5c0a-46ca-b519-bf31f699c947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:04.340988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dab2c-5c0a-46ca-b519-bf31f699c947 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:04.364291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1282/2586] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:04.365167 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b23991-c997-4859-9fd6-dbdec2df1e68 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:04.376203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b23991-c997-4859-9fd6-dbdec2df1e68 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:04.382779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e596cb-b601-40d2-b170-86684499204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:04.383632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e596cb-b601-40d2-b170-86684499204a admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.383919 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e596cb-b601-40d2-b170-86684499204a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.384196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e596cb-b601-40d2-b170-86684499204a admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.384928 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e596cb-b601-40d2-b170-86684499204a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:04.387617 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e596cb-b601-40d2-b170-86684499204a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:04.427068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1305/2587] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:04 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:04.433309 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dab2c-5c0a-46ca-b519-bf31f699c947 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:04.444338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dab2c-5c0a-46ca-b519-bf31f699c947 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:04.511804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c198ee-2c49-4d48-acef-e0880152994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:04.512762 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c198ee-2c49-4d48-acef-e0880152994a admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.513240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c198ee-2c49-4d48-acef-e0880152994a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.513657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c198ee-2c49-4d48-acef-e0880152994a admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.514551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c198ee-2c49-4d48-acef-e0880152994a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:04.517035 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c198ee-2c49-4d48-acef-e0880152994a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:04.542234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1283/2588] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:04 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:04.548605 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e596cb-b601-40d2-b170-86684499204a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:04.562314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e596cb-b601-40d2-b170-86684499204a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:04.567116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555bb27-239d-4ee3-8b76-8d6f318d9cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:04.567926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555bb27-239d-4ee3-8b76-8d6f318d9cee admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.568237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555bb27-239d-4ee3-8b76-8d6f318d9cee admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.568629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555bb27-239d-4ee3-8b76-8d6f318d9cee admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.588450 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555bb27-239d-4ee3-8b76-8d6f318d9cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:04.592492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555bb27-239d-4ee3-8b76-8d6f318d9cee admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:04.613208 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1306/2589] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:04.614404 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c198ee-2c49-4d48-acef-e0880152994a admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:04.628524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c198ee-2c49-4d48-acef-e0880152994a admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:04.638197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bbd6c-908e-458d-97bc-ba4c797eef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:04.638966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bbd6c-908e-458d-97bc-ba4c797eef87 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.639254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bbd6c-908e-458d-97bc-ba4c797eef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.639695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bbd6c-908e-458d-97bc-ba4c797eef87 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.640474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bbd6c-908e-458d-97bc-ba4c797eef87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:04.642342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bbd6c-908e-458d-97bc-ba4c797eef87 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:04.656288 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1284/2590] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:04.658172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555bb27-239d-4ee3-8b76-8d6f318d9cee admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:04.669018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555bb27-239d-4ee3-8b76-8d6f318d9cee admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:04.674788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b2c1b-7839-406c-b036-564392412486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:04.675704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b2c1b-7839-406c-b036-564392412486 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.675970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b2c1b-7839-406c-b036-564392412486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.676244 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b2c1b-7839-406c-b036-564392412486 admin admin] PATH_INFO: `/v3/projects/c9d62246e0df4dd9b6f9476cef427559/users/69a6a0ee2a44492bacc9f6f3e18f70b9/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.695441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b2c1b-7839-406c-b036-564392412486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d62246e0df4dd9b6f9476cef427559, user_id=69a6a0ee2a44492bacc9f6f3e18f70b9, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:04.698124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b2c1b-7839-406c-b036-564392412486 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:04.725390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1307/2591] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:04 2022] PUT /identity/v3/projects/c9d62246e0df4dd9b6f9476cef427559/users/69a6a0ee2a44492bacc9f6f3e18f70b9/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:04.726957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63276b8-b7ae-4315-96d7-d52212e14bbb None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.727258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63276b8-b7ae-4315-96d7-d52212e14bbb None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.727536 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63276b8-b7ae-4315-96d7-d52212e14bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.780969 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f63276b8-b7ae-4315-96d7-d52212e14bbb None None] MFA Rules not processed for user `69a6a0ee2a44492bacc9f6f3e18f70b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:04.783498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f63276b8-b7ae-4315-96d7-d52212e14bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:04.869197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1285/2592] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:58:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:04.896707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b2c1b-7839-406c-b036-564392412486 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:04.898811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-846b2c1b-7839-406c-b036-564392412486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:05.004528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b2c1b-7839-406c-b036-564392412486 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:05.008565 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ad650-4f74-4899-a359-bcaeb2d6837f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f94515985e244af29f47a49c0dd415ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:05.009357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad650-4f74-4899-a359-bcaeb2d6837f service glance] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:05.009719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad650-4f74-4899-a359-bcaeb2d6837f service glance] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:05.010222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad650-4f74-4899-a359-bcaeb2d6837f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:05.021690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad650-4f74-4899-a359-bcaeb2d6837f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:05.023672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad650-4f74-4899-a359-bcaeb2d6837f service glance] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:05.039774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1308/2593] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:06.095794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63276b8-b7ae-4315-96d7-d52212e14bbb None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:06.097242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f63276b8-b7ae-4315-96d7-d52212e14bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:06.191391 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63276b8-b7ae-4315-96d7-d52212e14bbb None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:06.202696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41332bdc-4184-43b5-bb2e-74703640b6cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:06.203384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41332bdc-4184-43b5-bb2e-74703640b6cf service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.203658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41332bdc-4184-43b5-bb2e-74703640b6cf service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.203946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41332bdc-4184-43b5-bb2e-74703640b6cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:06.205895 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-41332bdc-4184-43b5-bb2e-74703640b6cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:06.219717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41332bdc-4184-43b5-bb2e-74703640b6cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:06.221324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41332bdc-4184-43b5-bb2e-74703640b6cf service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:06.246450 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1286/2594] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:16.016446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ad650-4f74-4899-a359-bcaeb2d6837f service glance] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:16.017989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b27ad650-4f74-4899-a359-bcaeb2d6837f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:16.035552 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ad650-4f74-4899-a359-bcaeb2d6837f service glance] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:16.041587 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f11cc-0ca8-4b6f-8bf0-46668e60fc89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:16.042271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f11cc-0ca8-4b6f-8bf0-46668e60fc89 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:16.042575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f11cc-0ca8-4b6f-8bf0-46668e60fc89 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:16.042843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f11cc-0ca8-4b6f-8bf0-46668e60fc89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:16.044662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c84f11cc-0ca8-4b6f-8bf0-46668e60fc89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:16.057345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f11cc-0ca8-4b6f-8bf0-46668e60fc89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:16.059013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f11cc-0ca8-4b6f-8bf0-46668e60fc89 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:16.069915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1309/2595] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:19.596382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3fd8a-410a-49d8-8d79-8126db055a7d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.596805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3fd8a-410a-49d8-8d79-8126db055a7d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.596899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3fd8a-410a-49d8-8d79-8126db055a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.617163 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e4b3fd8a-410a-49d8-8d79-8126db055a7d None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:19.618526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e4b3fd8a-410a-49d8-8d79-8126db055a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:19.680146 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1287/2596] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:19.692786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f11cc-0ca8-4b6f-8bf0-46668e60fc89 service nova] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.694348 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c84f11cc-0ca8-4b6f-8bf0-46668e60fc89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:19.765517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f11cc-0ca8-4b6f-8bf0-46668e60fc89 service nova] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.771061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914767a-9625-41d8-8609-fe8c2d117f47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.771712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914767a-9625-41d8-8609-fe8c2d117f47 service swift] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.772017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914767a-9625-41d8-8609-fe8c2d117f47 service swift] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.772292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914767a-9625-41d8-8609-fe8c2d117f47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.780743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914767a-9625-41d8-8609-fe8c2d117f47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.782656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914767a-9625-41d8-8609-fe8c2d117f47 service swift] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.793018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1310/2597] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:58:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 19:58:33.217520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3fd8a-410a-49d8-8d79-8126db055a7d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:33.284021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3fd8a-410a-49d8-8d79-8126db055a7d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:33.289792 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:33.291066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.291347 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.291613 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] PATH_INFO: `/v3/users/69a6a0ee2a44492bacc9f6f3e18f70b9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.292910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a6a0ee2a44492bacc9f6f3e18f70b9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:33.294880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:33.345097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a6a0ee2a44492bacc9f6f3e18f70b9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.357313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a6a0ee2a44492bacc9f6f3e18f70b9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.358292 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a6a0ee2a44492bacc9f6f3e18f70b9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.366386 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a6a0ee2a44492bacc9f6f3e18f70b9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.367046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a6a0ee2a44492bacc9f6f3e18f70b9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.379738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1288/2598] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:33 2022] DELETE /identity/v3/users/69a6a0ee2a44492bacc9f6f3e18f70b9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:33.384418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf3942-36b5-4890-847a-a7089ca226f4 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.384975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf3942-36b5-4890-847a-a7089ca226f4 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.384975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf3942-36b5-4890-847a-a7089ca226f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.402929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-eecf3942-36b5-4890-847a-a7089ca226f4 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:33.404165 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-eecf3942-36b5-4890-847a-a7089ca226f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:33.463944 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1311/2599] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:33.474039 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:33.475562 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:33.530889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32280c3-3789-4fbe-b1bd-657979baf084 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:33.534897 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580005a-b896-4bcb-a19a-881ab9aeab2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:33.535527 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580005a-b896-4bcb-a19a-881ab9aeab2d service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.535802 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580005a-b896-4bcb-a19a-881ab9aeab2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.536074 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580005a-b896-4bcb-a19a-881ab9aeab2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.546953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580005a-b896-4bcb-a19a-881ab9aeab2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:33.548491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580005a-b896-4bcb-a19a-881ab9aeab2d service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:33.559059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1289/2600] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:33.832526 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf3942-36b5-4890-847a-a7089ca226f4 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:33.833988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-eecf3942-36b5-4890-847a-a7089ca226f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:33.847630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf3942-36b5-4890-847a-a7089ca226f4 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:33.852317 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:33.853496 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.853931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.854304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] PATH_INFO: `/v3/projects/c9d62246e0df4dd9b6f9476cef427559` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.855580 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d62246e0df4dd9b6f9476cef427559)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:33.857554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:33.903761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d62246e0df4dd9b6f9476cef427559', 'request_id': 'req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.909720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d62246e0df4dd9b6f9476cef427559', 'request_id': 'req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.918754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d62246e0df4dd9b6f9476cef427559', 'request_id': 'req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.928969 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] The token cache is being invalidate because project c9d62246e0df4dd9b6f9476cef427559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:33.929345 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.929956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ad2b144a-0dcf-489d-9bc9-d816ef1d9d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.931514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1312/2601] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:33 2022] DELETE /identity/v3/projects/c9d62246e0df4dd9b6f9476cef427559 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:33.936586 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168898e4-162c-4608-83ba-fb07c02c1722 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.936889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168898e4-162c-4608-83ba-fb07c02c1722 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.937161 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168898e4-162c-4608-83ba-fb07c02c1722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.955990 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-168898e4-162c-4608-83ba-fb07c02c1722 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:33.957058 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-168898e4-162c-4608-83ba-fb07c02c1722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:34.019049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1290/2602] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:34.028422 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317445-9e0a-4053-9fba-5a1465934e31 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:34.028700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317445-9e0a-4053-9fba-5a1465934e31 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:34.028972 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317445-9e0a-4053-9fba-5a1465934e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:34.047946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fc317445-9e0a-4053-9fba-5a1465934e31 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:34.049177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fc317445-9e0a-4053-9fba-5a1465934e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:34.057350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1313/2603] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:34.061716 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168898e4-162c-4608-83ba-fb07c02c1722 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:34.071193 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168898e4-162c-4608-83ba-fb07c02c1722 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:34.075827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b07de-aad6-4d83-92d9-019ff64ee8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:34.076510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b07de-aad6-4d83-92d9-019ff64ee8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:34.076758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b07de-aad6-4d83-92d9-019ff64ee8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:34.077054 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b07de-aad6-4d83-92d9-019ff64ee8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:34.077894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b07de-aad6-4d83-92d9-019ff64ee8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:34.078200 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b07de-aad6-4d83-92d9-019ff64ee8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:34.079782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b07de-aad6-4d83-92d9-019ff64ee8b9 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:34.095249 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1291/2604] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:34.096365 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317445-9e0a-4053-9fba-5a1465934e31 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:34.105878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317445-9e0a-4053-9fba-5a1465934e31 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:34.111589 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5ce46-70ec-4d69-97b2-00ec04f9f983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:34.112284 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5ce46-70ec-4d69-97b2-00ec04f9f983 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:34.112568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5ce46-70ec-4d69-97b2-00ec04f9f983 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:34.112836 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5ce46-70ec-4d69-97b2-00ec04f9f983 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:34.113529 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5ce46-70ec-4d69-97b2-00ec04f9f983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:34.115480 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5ce46-70ec-4d69-97b2-00ec04f9f983 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:34.146558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1314/2605] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:34 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:34.147702 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b07de-aad6-4d83-92d9-019ff64ee8b9 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:34.158013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b07de-aad6-4d83-92d9-019ff64ee8b9 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:34.217498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b70b2-d1e8-4f0e-af26-348666275b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:34.218225 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b70b2-d1e8-4f0e-af26-348666275b49 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:34.218812 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b70b2-d1e8-4f0e-af26-348666275b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:34.219043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b70b2-d1e8-4f0e-af26-348666275b49 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:34.219767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b70b2-d1e8-4f0e-af26-348666275b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:34.221758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b70b2-d1e8-4f0e-af26-348666275b49 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:34.242946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1292/2606] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:34 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:34.247101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5ce46-70ec-4d69-97b2-00ec04f9f983 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:34.257476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5ce46-70ec-4d69-97b2-00ec04f9f983 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:34.262052 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c7d86-f626-4372-a2ef-53e5900eda86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:34.262752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c7d86-f626-4372-a2ef-53e5900eda86 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:34.263036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c7d86-f626-4372-a2ef-53e5900eda86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:34.263325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c7d86-f626-4372-a2ef-53e5900eda86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:34.264057 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c7d86-f626-4372-a2ef-53e5900eda86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:34.265665 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c7d86-f626-4372-a2ef-53e5900eda86 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:34.278430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1315/2607] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:34.282537 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b70b2-d1e8-4f0e-af26-348666275b49 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:34.293089 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b70b2-d1e8-4f0e-af26-348666275b49 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:34.297760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316faeaf-3631-45ee-a668-d40b49a90bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:34.298611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316faeaf-3631-45ee-a668-d40b49a90bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:34.298886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316faeaf-3631-45ee-a668-d40b49a90bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:34.299187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316faeaf-3631-45ee-a668-d40b49a90bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:34.300147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316faeaf-3631-45ee-a668-d40b49a90bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:34.301828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316faeaf-3631-45ee-a668-d40b49a90bc8 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:34.312188 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1293/2608] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:34.316547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c7d86-f626-4372-a2ef-53e5900eda86 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:34.327228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c7d86-f626-4372-a2ef-53e5900eda86 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:34.331911 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc81ee5-e958-43b5-8d2d-0bc0f69afe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:34.332788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc81ee5-e958-43b5-8d2d-0bc0f69afe39 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:34.333059 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc81ee5-e958-43b5-8d2d-0bc0f69afe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:34.333338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc81ee5-e958-43b5-8d2d-0bc0f69afe39 admin admin] PATH_INFO: `/v3/projects/caaea13fb34d493fb8f7b7b3cf3b6ac4/users/b623a474e321490e9dfcd2b2306e12ea/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:34.358109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc81ee5-e958-43b5-8d2d-0bc0f69afe39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caaea13fb34d493fb8f7b7b3cf3b6ac4, user_id=b623a474e321490e9dfcd2b2306e12ea, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:34.361013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc81ee5-e958-43b5-8d2d-0bc0f69afe39 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:34.374412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1316/2609] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:34 2022] PUT /identity/v3/projects/caaea13fb34d493fb8f7b7b3cf3b6ac4/users/b623a474e321490e9dfcd2b2306e12ea/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:34.385026 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a74874-96ca-43ca-967b-3d2de187dea8 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:34.385319 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a74874-96ca-43ca-967b-3d2de187dea8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:34.385600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a74874-96ca-43ca-967b-3d2de187dea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:34.413894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-38a74874-96ca-43ca-967b-3d2de187dea8 None None] MFA Rules not processed for user `b623a474e321490e9dfcd2b2306e12ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:34.415205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-38a74874-96ca-43ca-967b-3d2de187dea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:34.482072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1294/2610] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:58:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:34.493507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc81ee5-e958-43b5-8d2d-0bc0f69afe39 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:34.495630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7cc81ee5-e958-43b5-8d2d-0bc0f69afe39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:34.559514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc81ee5-e958-43b5-8d2d-0bc0f69afe39 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:34.563163 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f587-aaaf-425c-a442-63a31bb45a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:34.563810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f587-aaaf-425c-a442-63a31bb45a94 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:34.564087 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f587-aaaf-425c-a442-63a31bb45a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:34.564357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f587-aaaf-425c-a442-63a31bb45a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:34.574197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363f587-aaaf-425c-a442-63a31bb45a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:34.575695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363f587-aaaf-425c-a442-63a31bb45a94 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:34.585849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1317/2611] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:35.565784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111540ed-136f-4467-8a2a-c233b6dfe8de None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:35.566411 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111540ed-136f-4467-8a2a-c233b6dfe8de None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:35.566411 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111540ed-136f-4467-8a2a-c233b6dfe8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:35.584415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-111540ed-136f-4467-8a2a-c233b6dfe8de None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:35.585694 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-111540ed-136f-4467-8a2a-c233b6dfe8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:35.643013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1295/2612] 10.222.0.20 () {58 vars in 967 bytes} [Fri Oct 28 19:58:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:35.656133 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f587-aaaf-425c-a442-63a31bb45a94 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:35.657663 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9363f587-aaaf-425c-a442-63a31bb45a94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:35.727740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f587-aaaf-425c-a442-63a31bb45a94 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:35.733074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8b68c-0bf0-48e3-92f8-dc0f8e841b17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:35.733715 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8b68c-0bf0-48e3-92f8-dc0f8e841b17 service swift] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:35.733990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8b68c-0bf0-48e3-92f8-dc0f8e841b17 service swift] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:35.734296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8b68c-0bf0-48e3-92f8-dc0f8e841b17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:35.742784 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8b68c-0bf0-48e3-92f8-dc0f8e841b17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:35.744383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8b68c-0bf0-48e3-92f8-dc0f8e841b17 service swift] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:35.752623 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1318/2613] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 19:58:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:58:38.316465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeab849-ee46-4358-a083-6b0ce49d0d0d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:38.317002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeab849-ee46-4358-a083-6b0ce49d0d0d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:38.317002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeab849-ee46-4358-a083-6b0ce49d0d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:38.336589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-dfeab849-ee46-4358-a083-6b0ce49d0d0d None None] MFA Rules not processed for user `cc688d3f2f7f4230a5715b5ba437ea59`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:38.337841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-dfeab849-ee46-4358-a083-6b0ce49d0d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:38.399216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1296/2614] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:58:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:57.778697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8b68c-0bf0-48e3-92f8-dc0f8e841b17 service swift] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.780253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6ab8b68c-0bf0-48e3-92f8-dc0f8e841b17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:57.837991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8b68c-0bf0-48e3-92f8-dc0f8e841b17 service swift] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.842050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeec10b-acb8-414f-a161-c8c9acf48554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.842771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeec10b-acb8-414f-a161-c8c9acf48554 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.843072 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeec10b-acb8-414f-a161-c8c9acf48554 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.843331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeec10b-acb8-414f-a161-c8c9acf48554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.845513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-dfeec10b-acb8-414f-a161-c8c9acf48554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:57.908635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeec10b-acb8-414f-a161-c8c9acf48554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.910102 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeec10b-acb8-414f-a161-c8c9acf48554 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.919378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1319/2615] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:58.874613 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeab849-ee46-4358-a083-6b0ce49d0d0d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.876173 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-dfeab849-ee46-4358-a083-6b0ce49d0d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:58.983209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeab849-ee46-4358-a083-6b0ce49d0d0d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.989477 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea7a0-af09-4752-85a3-443419f72468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.990183 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea7a0-af09-4752-85a3-443419f72468 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.990468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea7a0-af09-4752-85a3-443419f72468 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.990795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea7a0-af09-4752-85a3-443419f72468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.992966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c6cea7a0-af09-4752-85a3-443419f72468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:59.008274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cea7a0-af09-4752-85a3-443419f72468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:59.016956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cea7a0-af09-4752-85a3-443419f72468 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:59.030273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1297/2616] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:02.830386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeec10b-acb8-414f-a161-c8c9acf48554 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:02.834518 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-dfeec10b-acb8-414f-a161-c8c9acf48554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:02.845910 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeec10b-acb8-414f-a161-c8c9acf48554 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:02.849852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8031c5-a78e-41f9-ab6a-1c2051797c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:02.850482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8031c5-a78e-41f9-ab6a-1c2051797c61 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:02.850756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8031c5-a78e-41f9-ab6a-1c2051797c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:02.851018 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8031c5-a78e-41f9-ab6a-1c2051797c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:02.852957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7f8031c5-a78e-41f9-ab6a-1c2051797c61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:02.919610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8031c5-a78e-41f9-ab6a-1c2051797c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:02.921101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8031c5-a78e-41f9-ab6a-1c2051797c61 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:02.931016 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1320/2617] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:09.090965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea7a0-af09-4752-85a3-443419f72468 service nova] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:09.101348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea7a0-af09-4752-85a3-443419f72468 service nova] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:09.105480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7f46e-2be8-4cf4-80ad-b9854e04bd43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:09.106501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7f46e-2be8-4cf4-80ad-b9854e04bd43 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.106682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7f46e-2be8-4cf4-80ad-b9854e04bd43 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.107003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7f46e-2be8-4cf4-80ad-b9854e04bd43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.109546 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-cfd7f46e-2be8-4cf4-80ad-b9854e04bd43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:09.178993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7f46e-2be8-4cf4-80ad-b9854e04bd43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:09.180739 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7f46e-2be8-4cf4-80ad-b9854e04bd43 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:09.197085 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1298/2618] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:10.036480 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8031c5-a78e-41f9-ab6a-1c2051797c61 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.056201 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8031c5-a78e-41f9-ab6a-1c2051797c61 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.061258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.062176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.062455 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.062733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] PATH_INFO: `/v3/users/b623a474e321490e9dfcd2b2306e12ea` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.064185 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b623a474e321490e9dfcd2b2306e12ea)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.066138 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.119490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b623a474e321490e9dfcd2b2306e12ea'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.132401 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b623a474e321490e9dfcd2b2306e12ea'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.133177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b623a474e321490e9dfcd2b2306e12ea'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.133778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b623a474e321490e9dfcd2b2306e12ea'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.146551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b623a474e321490e9dfcd2b2306e12ea'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.167899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1321/2619] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:10 2022] DELETE /identity/v3/users/b623a474e321490e9dfcd2b2306e12ea => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:10.169276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7293c5-313b-40e2-b7be-88353466a250 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.169744 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7293c5-313b-40e2-b7be-88353466a250 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.169858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7293c5-313b-40e2-b7be-88353466a250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.199543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-8a7293c5-313b-40e2-b7be-88353466a250 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:10.201138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8a7293c5-313b-40e2-b7be-88353466a250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:10.303616 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1299/2620] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:10.309358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.310783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:10.411415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5a51c-3734-47aa-b57f-37c3cbf75d53 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.420716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3cc04-893c-4a40-b951-3c54e2352830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.421528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3cc04-893c-4a40-b951-3c54e2352830 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.422753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3cc04-893c-4a40-b951-3c54e2352830 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.423177 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3cc04-893c-4a40-b951-3c54e2352830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.459797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3cc04-893c-4a40-b951-3c54e2352830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.461404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3cc04-893c-4a40-b951-3c54e2352830 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.465456 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7293c5-313b-40e2-b7be-88353466a250 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.468110 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8a7293c5-313b-40e2-b7be-88353466a250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:10.473483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1322/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:10.539946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3cc04-893c-4a40-b951-3c54e2352830 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.541925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-87a3cc04-893c-4a40-b951-3c54e2352830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:10.565321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3cc04-893c-4a40-b951-3c54e2352830 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.573946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.576054 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.576344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.576619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] PATH_INFO: `/v3/users/743564ffbc354c85814a07001a3c387e` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.578571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=743564ffbc354c85814a07001a3c387e)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.580555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.597296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7293c5-313b-40e2-b7be-88353466a250 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.605774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11633a-d90f-4d1a-af0c-2ef7cba4b1c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.606669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11633a-d90f-4d1a-af0c-2ef7cba4b1c2 service placement] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.607355 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11633a-d90f-4d1a-af0c-2ef7cba4b1c2 service placement] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.607355 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11633a-d90f-4d1a-af0c-2ef7cba4b1c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.610384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ae11633a-d90f-4d1a-af0c-2ef7cba4b1c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:10.624791 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11633a-d90f-4d1a-af0c-2ef7cba4b1c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.626510 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11633a-d90f-4d1a-af0c-2ef7cba4b1c2 service placement] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.638866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1300/2622] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:59:10.648061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743564ffbc354c85814a07001a3c387e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.667415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743564ffbc354c85814a07001a3c387e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.668348 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743564ffbc354c85814a07001a3c387e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.668661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743564ffbc354c85814a07001a3c387e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.678935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743564ffbc354c85814a07001a3c387e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.695296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1323/2623] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:10 2022] DELETE /identity/v3/users/743564ffbc354c85814a07001a3c387e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:10.834174 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11633a-d90f-4d1a-af0c-2ef7cba4b1c2 service placement] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.835648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ae11633a-d90f-4d1a-af0c-2ef7cba4b1c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:10.850540 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11633a-d90f-4d1a-af0c-2ef7cba4b1c2 service placement] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.906250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.907720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:10.913962 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.914944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.915223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.915494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] PATH_INFO: `/v3/projects/caaea13fb34d493fb8f7b7b3cf3b6ac4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.917084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caaea13fb34d493fb8f7b7b3cf3b6ac4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.919283 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.968176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caaea13fb34d493fb8f7b7b3cf3b6ac4', 'request_id': 'req-ceff0731-365a-47bc-af14-2be997d3aac8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.974358 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caaea13fb34d493fb8f7b7b3cf3b6ac4', 'request_id': 'req-ceff0731-365a-47bc-af14-2be997d3aac8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.982531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caaea13fb34d493fb8f7b7b3cf3b6ac4', 'request_id': 'req-ceff0731-365a-47bc-af14-2be997d3aac8'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.984548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371c67d-a3d3-45f4-859e-f7a0518fee21 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.994765 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] The token cache is being invalidate because project caaea13fb34d493fb8f7b7b3cf3b6ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:10.995050 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.995678 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:10.997212 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1301/2624] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:10 2022] DELETE /identity/v3/projects/caaea13fb34d493fb8f7b7b3cf3b6ac4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:11.043259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:11.044600 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:11.044899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:11.045175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] PATH_INFO: `/v3/projects/37c9db6cc9ff4036a092c91138e6c6b3` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:11.046596 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c9db6cc9ff4036a092c91138e6c6b3)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:11.048566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:11.102558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c9db6cc9ff4036a092c91138e6c6b3', 'request_id': 'req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.109549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c9db6cc9ff4036a092c91138e6c6b3', 'request_id': 'req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.118929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c9db6cc9ff4036a092c91138e6c6b3', 'request_id': 'req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.130022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] The token cache is being invalidate because project 37c9db6cc9ff4036a092c91138e6c6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:11.130350 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.131004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.135692 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1324/2625] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:10 2022] DELETE /identity/v3/projects/37c9db6cc9ff4036a092c91138e6c6b3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:59:11.139233 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:11.140803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:11.154683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff0731-365a-47bc-af14-2be997d3aac8 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:11.216217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:11.217228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:11.217575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:11.218069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] PATH_INFO: `/v3/users/236e31647c024eb2a09d1607a32a7ec4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:11.219446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236e31647c024eb2a09d1607a32a7ec4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:11.221488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:11.271213 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236e31647c024eb2a09d1607a32a7ec4'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.282589 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236e31647c024eb2a09d1607a32a7ec4'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.283421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236e31647c024eb2a09d1607a32a7ec4'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.292815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236e31647c024eb2a09d1607a32a7ec4'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.293420 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236e31647c024eb2a09d1607a32a7ec4'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.305068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1302/2626] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:11 2022] DELETE /identity/v3/users/236e31647c024eb2a09d1607a32a7ec4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:11.473555 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:11.475133 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:11.488038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3010e2-2d8d-4ad8-ad7e-2c3441a26756 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:11.543446 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:11.544293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:11.544566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:11.544829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] PATH_INFO: `/v3/projects/227dc1f40cb645149e3c99698b5229a2` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:11.546145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=227dc1f40cb645149e3c99698b5229a2)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:11.548228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:11.597304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227dc1f40cb645149e3c99698b5229a2', 'request_id': 'req-c28696b5-ed11-42a0-a83c-e9df5942dac6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.603890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227dc1f40cb645149e3c99698b5229a2', 'request_id': 'req-c28696b5-ed11-42a0-a83c-e9df5942dac6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.613170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227dc1f40cb645149e3c99698b5229a2', 'request_id': 'req-c28696b5-ed11-42a0-a83c-e9df5942dac6'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.624924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] The token cache is being invalidate because project 227dc1f40cb645149e3c99698b5229a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:11.625239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.626110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:11.628206 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1325/2627] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:11 2022] DELETE /identity/v3/projects/227dc1f40cb645149e3c99698b5229a2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:13.060113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:13.062157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:13.126764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb5806-7b6b-4280-9f3d-998bee2a5f80 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:13.177151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0d5d3-2b91-4194-97ac-d2914c8e44ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:13.177781 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0d5d3-2b91-4194-97ac-d2914c8e44ae service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:13.178057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0d5d3-2b91-4194-97ac-d2914c8e44ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:13.178353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0d5d3-2b91-4194-97ac-d2914c8e44ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:13.180276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9bf0d5d3-2b91-4194-97ac-d2914c8e44ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:13.243957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0d5d3-2b91-4194-97ac-d2914c8e44ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:13.245382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0d5d3-2b91-4194-97ac-d2914c8e44ae service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:13.255028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1303/2628] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:16.410412 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:16.412079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:16.426972 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28696b5-ed11-42a0-a83c-e9df5942dac6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:16.431642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:16.432578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:16.432920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:16.433197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] PATH_INFO: `/v3/users/cfa08e94c62b458ca5aa23a53d30f817` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:16.434432 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa08e94c62b458ca5aa23a53d30f817)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:16.436472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:16.490298 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa08e94c62b458ca5aa23a53d30f817'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.497215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa08e94c62b458ca5aa23a53d30f817'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.498155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa08e94c62b458ca5aa23a53d30f817'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.498756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa08e94c62b458ca5aa23a53d30f817'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.506997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-52873546-ead7-442b-bca7-ecf157ba3de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa08e94c62b458ca5aa23a53d30f817'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.520104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1326/2629] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:16 2022] DELETE /identity/v3/users/cfa08e94c62b458ca5aa23a53d30f817 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:16.702888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0d5d3-2b91-4194-97ac-d2914c8e44ae service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:16.714479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0d5d3-2b91-4194-97ac-d2914c8e44ae service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:16.778746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:16.779798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:16.780136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:16.780464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] PATH_INFO: `/v3/projects/f5919c7c8c5640909e1b61e1cd886421` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:16.781801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5919c7c8c5640909e1b61e1cd886421)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:16.783804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:16.834624 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5919c7c8c5640909e1b61e1cd886421', 'request_id': 'req-c04bad5f-2e3c-47e0-9717-acfda45d0d19'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.841371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5919c7c8c5640909e1b61e1cd886421', 'request_id': 'req-c04bad5f-2e3c-47e0-9717-acfda45d0d19'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.851721 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5919c7c8c5640909e1b61e1cd886421', 'request_id': 'req-c04bad5f-2e3c-47e0-9717-acfda45d0d19'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.864315 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] The token cache is being invalidate because project f5919c7c8c5640909e1b61e1cd886421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:16.864618 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.865243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c04bad5f-2e3c-47e0-9717-acfda45d0d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.866877 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1304/2630] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:16 2022] DELETE /identity/v3/projects/f5919c7c8c5640909e1b61e1cd886421 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:16.872044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4889a-247e-44fc-aea5-b03abed350f9 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:16.872346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4889a-247e-44fc-aea5-b03abed350f9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:16.872640 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4889a-247e-44fc-aea5-b03abed350f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:16.890352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-38f4889a-247e-44fc-aea5-b03abed350f9 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:16.891494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-38f4889a-247e-44fc-aea5-b03abed350f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:16.957410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1327/2631] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:16.965182 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e732eb-d94a-48c0-ab38-6bed29198c01 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:16.965503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e732eb-d94a-48c0-ab38-6bed29198c01 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:16.965785 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e732eb-d94a-48c0-ab38-6bed29198c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:16.984977 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-38e732eb-d94a-48c0-ab38-6bed29198c01 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:16.986197 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-38e732eb-d94a-48c0-ab38-6bed29198c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:16.995422 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1305/2632] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:16.999991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4889a-247e-44fc-aea5-b03abed350f9 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.010114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4889a-247e-44fc-aea5-b03abed350f9 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.015976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66b8cc-ba7e-4d54-b665-6cd8e3d9102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.016630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66b8cc-ba7e-4d54-b665-6cd8e3d9102a admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.016903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66b8cc-ba7e-4d54-b665-6cd8e3d9102a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.017166 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66b8cc-ba7e-4d54-b665-6cd8e3d9102a admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.017887 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66b8cc-ba7e-4d54-b665-6cd8e3d9102a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:17.018217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66b8cc-ba7e-4d54-b665-6cd8e3d9102a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.020105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66b8cc-ba7e-4d54-b665-6cd8e3d9102a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.031790 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1328/2633] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:17.036148 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e732eb-d94a-48c0-ab38-6bed29198c01 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.046121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e732eb-d94a-48c0-ab38-6bed29198c01 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.052001 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87d066-d4c7-4eca-b1cf-b19ba6228ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.052655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87d066-d4c7-4eca-b1cf-b19ba6228ced admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.052938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87d066-d4c7-4eca-b1cf-b19ba6228ced admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.053187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87d066-d4c7-4eca-b1cf-b19ba6228ced admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.053889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87d066-d4c7-4eca-b1cf-b19ba6228ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.055828 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87d066-d4c7-4eca-b1cf-b19ba6228ced admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.093633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1306/2634] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:17 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:17.099742 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66b8cc-ba7e-4d54-b665-6cd8e3d9102a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.109918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66b8cc-ba7e-4d54-b665-6cd8e3d9102a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.173740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e88ef6-1ea3-43fc-908c-f7b35b464c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.174348 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e88ef6-1ea3-43fc-908c-f7b35b464c03 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.174625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e88ef6-1ea3-43fc-908c-f7b35b464c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.174887 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e88ef6-1ea3-43fc-908c-f7b35b464c03 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.175570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e88ef6-1ea3-43fc-908c-f7b35b464c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.177487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e88ef6-1ea3-43fc-908c-f7b35b464c03 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.201382 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1329/2635] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:17 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:17.206264 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87d066-d4c7-4eca-b1cf-b19ba6228ced admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.220549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87d066-d4c7-4eca-b1cf-b19ba6228ced admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.225675 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d6b9-32c6-4795-b277-040cc4943b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.226359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d6b9-32c6-4795-b277-040cc4943b80 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.226634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d6b9-32c6-4795-b277-040cc4943b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.226900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d6b9-32c6-4795-b277-040cc4943b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.227629 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d6b9-32c6-4795-b277-040cc4943b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.229215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d6b9-32c6-4795-b277-040cc4943b80 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.239231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1307/2636] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:59:17.243360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e88ef6-1ea3-43fc-908c-f7b35b464c03 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.253356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e88ef6-1ea3-43fc-908c-f7b35b464c03 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.258524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643a04f-f60a-4d72-a981-e1e24da3699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.259174 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643a04f-f60a-4d72-a981-e1e24da3699e admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.259447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643a04f-f60a-4d72-a981-e1e24da3699e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.259714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643a04f-f60a-4d72-a981-e1e24da3699e admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.260465 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643a04f-f60a-4d72-a981-e1e24da3699e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.262042 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643a04f-f60a-4d72-a981-e1e24da3699e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.272096 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1330/2637] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:17.276321 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d6b9-32c6-4795-b277-040cc4943b80 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.286821 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d6b9-32c6-4795-b277-040cc4943b80 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.293059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108b809-42cd-435d-9b8d-7199b05a21bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.293950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108b809-42cd-435d-9b8d-7199b05a21bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.294269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108b809-42cd-435d-9b8d-7199b05a21bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.294571 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108b809-42cd-435d-9b8d-7199b05a21bc admin admin] PATH_INFO: `/v3/projects/930c2e3dc0164a978ff8333e8ece5f5c/users/19377f65808a409fa4ee69f49641a010/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.309323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108b809-42cd-435d-9b8d-7199b05a21bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=930c2e3dc0164a978ff8333e8ece5f5c, user_id=19377f65808a409fa4ee69f49641a010, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.312041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108b809-42cd-435d-9b8d-7199b05a21bc admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.326809 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1308/2638] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:17 2022] PUT /identity/v3/projects/930c2e3dc0164a978ff8333e8ece5f5c/users/19377f65808a409fa4ee69f49641a010/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:17.338493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cb4de-86ed-4e1e-8d4c-41beac79b27f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.338780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cb4de-86ed-4e1e-8d4c-41beac79b27f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.339051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cb4de-86ed-4e1e-8d4c-41beac79b27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.365171 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4d6cb4de-86ed-4e1e-8d4c-41beac79b27f None None] MFA Rules not processed for user `19377f65808a409fa4ee69f49641a010`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:17.366436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4d6cb4de-86ed-4e1e-8d4c-41beac79b27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:17.432202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1331/2639] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:17.443360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108b809-42cd-435d-9b8d-7199b05a21bc admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.445416 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3108b809-42cd-435d-9b8d-7199b05a21bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:17.520658 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108b809-42cd-435d-9b8d-7199b05a21bc admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.527408 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88527e-a40e-4f5d-a31e-5ecaa76dab97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.528055 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88527e-a40e-4f5d-a31e-5ecaa76dab97 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.528329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88527e-a40e-4f5d-a31e-5ecaa76dab97 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.528596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88527e-a40e-4f5d-a31e-5ecaa76dab97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.536773 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88527e-a40e-4f5d-a31e-5ecaa76dab97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.538393 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88527e-a40e-4f5d-a31e-5ecaa76dab97 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.547747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1309/2640] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:20.299763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cb4de-86ed-4e1e-8d4c-41beac79b27f None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:20.368663 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cb4de-86ed-4e1e-8d4c-41beac79b27f None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:20.374024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:20.375104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:20.375629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:20.375906 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] PATH_INFO: `/v3/users/19377f65808a409fa4ee69f49641a010` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:20.377116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19377f65808a409fa4ee69f49641a010)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:20.379116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:20.433014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19377f65808a409fa4ee69f49641a010'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.447088 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19377f65808a409fa4ee69f49641a010'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.447828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19377f65808a409fa4ee69f49641a010'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.448440 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19377f65808a409fa4ee69f49641a010'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.457500 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19377f65808a409fa4ee69f49641a010'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.474000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1332/2641] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:20 2022] DELETE /identity/v3/users/19377f65808a409fa4ee69f49641a010 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:20.475697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b3833-0b87-4fee-9f92-7f9176c64098 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:20.476154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b3833-0b87-4fee-9f92-7f9176c64098 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:20.476154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b3833-0b87-4fee-9f92-7f9176c64098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:20.500291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e68b3833-0b87-4fee-9f92-7f9176c64098 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:20.501574 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e68b3833-0b87-4fee-9f92-7f9176c64098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:20.565745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1310/2642] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:20.576655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:20.578172 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:20.634839 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310701b-a113-4b1e-8f1d-da2be48e7637 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:20.638787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c4f57-6f04-4662-a319-f422081ba641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:20.639022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c4f57-6f04-4662-a319-f422081ba641 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:20.639310 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c4f57-6f04-4662-a319-f422081ba641 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:20.639582 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c4f57-6f04-4662-a319-f422081ba641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:20.650221 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c4f57-6f04-4662-a319-f422081ba641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:20.651662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c4f57-6f04-4662-a319-f422081ba641 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:20.661844 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1333/2643] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:20.935498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b3833-0b87-4fee-9f92-7f9176c64098 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:20.937824 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e68b3833-0b87-4fee-9f92-7f9176c64098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:20.955495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b3833-0b87-4fee-9f92-7f9176c64098 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:20.968657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:20.969577 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:20.969851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:20.970148 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] PATH_INFO: `/v3/projects/930c2e3dc0164a978ff8333e8ece5f5c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:20.971333 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930c2e3dc0164a978ff8333e8ece5f5c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:20.973231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.024120 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930c2e3dc0164a978ff8333e8ece5f5c', 'request_id': 'req-c3101b6a-229e-4420-96d4-383465540097'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:21.030633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930c2e3dc0164a978ff8333e8ece5f5c', 'request_id': 'req-c3101b6a-229e-4420-96d4-383465540097'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:21.039492 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930c2e3dc0164a978ff8333e8ece5f5c', 'request_id': 'req-c3101b6a-229e-4420-96d4-383465540097'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:21.050097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] The token cache is being invalidate because project 930c2e3dc0164a978ff8333e8ece5f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:21.050419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:21.051024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-c3101b6a-229e-4420-96d4-383465540097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:21.052572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1311/2644] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:20 2022] DELETE /identity/v3/projects/930c2e3dc0164a978ff8333e8ece5f5c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:21.057720 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd444f07-f44c-4832-915b-b3d82fe49511 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.058009 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd444f07-f44c-4832-915b-b3d82fe49511 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.058322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd444f07-f44c-4832-915b-b3d82fe49511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.075566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-fd444f07-f44c-4832-915b-b3d82fe49511 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:21.076744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-fd444f07-f44c-4832-915b-b3d82fe49511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:21.138524 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1334/2645] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:21.148193 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbafc28-0b6c-4e72-84c0-d8004bdf3a1a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.148635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbafc28-0b6c-4e72-84c0-d8004bdf3a1a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.148883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbafc28-0b6c-4e72-84c0-d8004bdf3a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.170766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-9fbafc28-0b6c-4e72-84c0-d8004bdf3a1a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:21.171995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9fbafc28-0b6c-4e72-84c0-d8004bdf3a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:21.181412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1312/2646] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:21.187433 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd444f07-f44c-4832-915b-b3d82fe49511 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.198474 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd444f07-f44c-4832-915b-b3d82fe49511 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.203657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495003b8-e910-4155-8d38-57cc2011a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.204438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495003b8-e910-4155-8d38-57cc2011a735 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.204854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495003b8-e910-4155-8d38-57cc2011a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.205134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495003b8-e910-4155-8d38-57cc2011a735 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.205878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495003b8-e910-4155-8d38-57cc2011a735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:21.206292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495003b8-e910-4155-8d38-57cc2011a735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.207894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495003b8-e910-4155-8d38-57cc2011a735 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.220103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1335/2647] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:21.224879 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbafc28-0b6c-4e72-84c0-d8004bdf3a1a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.235313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbafc28-0b6c-4e72-84c0-d8004bdf3a1a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.240566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fb65e-891a-4273-ba88-835ee3185385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.241203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fb65e-891a-4273-ba88-835ee3185385 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.241480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fb65e-891a-4273-ba88-835ee3185385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.241748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fb65e-891a-4273-ba88-835ee3185385 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.242471 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fb65e-891a-4273-ba88-835ee3185385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.244401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fb65e-891a-4273-ba88-835ee3185385 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.272091 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1313/2648] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:21.278258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495003b8-e910-4155-8d38-57cc2011a735 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.292360 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495003b8-e910-4155-8d38-57cc2011a735 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.356304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59def9-3106-460b-8bb1-1def8eedffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.356943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59def9-3106-460b-8bb1-1def8eedffed admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.357242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59def9-3106-460b-8bb1-1def8eedffed admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.357494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59def9-3106-460b-8bb1-1def8eedffed admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.358297 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59def9-3106-460b-8bb1-1def8eedffed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.360218 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59def9-3106-460b-8bb1-1def8eedffed admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.382743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1336/2649] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:21.387046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fb65e-891a-4273-ba88-835ee3185385 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.397682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fb65e-891a-4273-ba88-835ee3185385 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.403130 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788e67a-203d-47ed-ae18-abe7d3d8e625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.403796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788e67a-203d-47ed-ae18-abe7d3d8e625 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.404077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788e67a-203d-47ed-ae18-abe7d3d8e625 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.404329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788e67a-203d-47ed-ae18-abe7d3d8e625 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.405062 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788e67a-203d-47ed-ae18-abe7d3d8e625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.406697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788e67a-203d-47ed-ae18-abe7d3d8e625 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.417430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1314/2650] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:21.421456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59def9-3106-460b-8bb1-1def8eedffed admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.432006 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59def9-3106-460b-8bb1-1def8eedffed admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.437299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3516fa-e540-446f-b504-abb6f70bccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.437956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3516fa-e540-446f-b504-abb6f70bccd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.438275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3516fa-e540-446f-b504-abb6f70bccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.438568 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3516fa-e540-446f-b504-abb6f70bccd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.439289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3516fa-e540-446f-b504-abb6f70bccd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.440877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3516fa-e540-446f-b504-abb6f70bccd4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.451034 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1337/2651] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:21.455141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788e67a-203d-47ed-ae18-abe7d3d8e625 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.465094 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788e67a-203d-47ed-ae18-abe7d3d8e625 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.470069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e063cc-c6f3-4a61-abd3-faa8f01506cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.470966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e063cc-c6f3-4a61-abd3-faa8f01506cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.471247 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e063cc-c6f3-4a61-abd3-faa8f01506cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.471504 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e063cc-c6f3-4a61-abd3-faa8f01506cd admin admin] PATH_INFO: `/v3/projects/a3cbdf21fb084e8e97b9c7b0038ad940/users/ae2e3750e39e4ee89cb4e174bb08e2a2/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.486799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e063cc-c6f3-4a61-abd3-faa8f01506cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cbdf21fb084e8e97b9c7b0038ad940, user_id=ae2e3750e39e4ee89cb4e174bb08e2a2, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.489501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e063cc-c6f3-4a61-abd3-faa8f01506cd admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.505210 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1315/2652] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:21 2022] PUT /identity/v3/projects/a3cbdf21fb084e8e97b9c7b0038ad940/users/ae2e3750e39e4ee89cb4e174bb08e2a2/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:21.516617 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8ea04-e524-4669-b9e2-17194bfca921 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.516998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8ea04-e524-4669-b9e2-17194bfca921 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.517361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8ea04-e524-4669-b9e2-17194bfca921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.546373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-e8c8ea04-e524-4669-b9e2-17194bfca921 None None] MFA Rules not processed for user `ae2e3750e39e4ee89cb4e174bb08e2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:21.547492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e8c8ea04-e524-4669-b9e2-17194bfca921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:21.609787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1338/2653] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:21.616107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e063cc-c6f3-4a61-abd3-faa8f01506cd admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.680187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e063cc-c6f3-4a61-abd3-faa8f01506cd admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.684827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144421b8-4b82-43d3-a731-6e878f738dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.685488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144421b8-4b82-43d3-a731-6e878f738dab admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.685771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144421b8-4b82-43d3-a731-6e878f738dab admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.686043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144421b8-4b82-43d3-a731-6e878f738dab admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.686777 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144421b8-4b82-43d3-a731-6e878f738dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.688679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144421b8-4b82-43d3-a731-6e878f738dab admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.722605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1316/2654] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:21.727069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8ea04-e524-4669-b9e2-17194bfca921 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.738733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8ea04-e524-4669-b9e2-17194bfca921 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.801367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969323ac-be25-4ded-bbbc-a000dc7ac3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.801954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969323ac-be25-4ded-bbbc-a000dc7ac3ff admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.802272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969323ac-be25-4ded-bbbc-a000dc7ac3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.802545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969323ac-be25-4ded-bbbc-a000dc7ac3ff admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.803269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969323ac-be25-4ded-bbbc-a000dc7ac3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.805236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969323ac-be25-4ded-bbbc-a000dc7ac3ff admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.826945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1339/2655] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/users => generated 308 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:21.831175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144421b8-4b82-43d3-a731-6e878f738dab admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.842010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144421b8-4b82-43d3-a731-6e878f738dab admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.847542 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c52621-6544-4f7d-bff0-aef258ef420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.848202 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c52621-6544-4f7d-bff0-aef258ef420e admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.848473 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c52621-6544-4f7d-bff0-aef258ef420e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.848774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c52621-6544-4f7d-bff0-aef258ef420e admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.849541 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c52621-6544-4f7d-bff0-aef258ef420e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.851238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c52621-6544-4f7d-bff0-aef258ef420e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.861916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1317/2656] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:21.866124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969323ac-be25-4ded-bbbc-a000dc7ac3ff admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.876305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969323ac-be25-4ded-bbbc-a000dc7ac3ff admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.881332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad7bed-79b8-4813-bf03-ea292f89ee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.882207 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad7bed-79b8-4813-bf03-ea292f89ee6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.882506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad7bed-79b8-4813-bf03-ea292f89ee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.882772 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad7bed-79b8-4813-bf03-ea292f89ee6f admin admin] PATH_INFO: `/v3/projects/eba0f9036b504b0091e6ffc38f087c87/users/48905040242a4a99bdb7344b83fa3d52/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.897498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad7bed-79b8-4813-bf03-ea292f89ee6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba0f9036b504b0091e6ffc38f087c87, user_id=48905040242a4a99bdb7344b83fa3d52, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.900146 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad7bed-79b8-4813-bf03-ea292f89ee6f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.915542 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1340/2657] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:21 2022] PUT /identity/v3/projects/eba0f9036b504b0091e6ffc38f087c87/users/48905040242a4a99bdb7344b83fa3d52/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:21.919941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c52621-6544-4f7d-bff0-aef258ef420e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.931470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c52621-6544-4f7d-bff0-aef258ef420e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.992285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c701-5eef-4e29-b559-d937cce50459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.992946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c701-5eef-4e29-b559-d937cce50459 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.993229 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c701-5eef-4e29-b559-d937cce50459 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.993576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c701-5eef-4e29-b559-d937cce50459 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.994291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70c701-5eef-4e29-b559-d937cce50459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.995953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70c701-5eef-4e29-b559-d937cce50459 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:22.005767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1318/2658] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:59:22.010854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad7bed-79b8-4813-bf03-ea292f89ee6f admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:22.025713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad7bed-79b8-4813-bf03-ea292f89ee6f admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:22.031632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd952d-fa9a-46b6-b573-39ee951b917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:22.032523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd952d-fa9a-46b6-b573-39ee951b917c admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:22.032805 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd952d-fa9a-46b6-b573-39ee951b917c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:22.033075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd952d-fa9a-46b6-b573-39ee951b917c admin admin] PATH_INFO: `/v3/projects/eba0f9036b504b0091e6ffc38f087c87/users/48905040242a4a99bdb7344b83fa3d52/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:22.035291 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd952d-fa9a-46b6-b573-39ee951b917c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba0f9036b504b0091e6ffc38f087c87, user_id=48905040242a4a99bdb7344b83fa3d52, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:22.037964 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd952d-fa9a-46b6-b573-39ee951b917c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:22.049767 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1341/2659] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:22 2022] PUT /identity/v3/projects/eba0f9036b504b0091e6ffc38f087c87/users/48905040242a4a99bdb7344b83fa3d52/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:22.061634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150592-ef58-4715-9eb9-2163fc47c134 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:22.062304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150592-ef58-4715-9eb9-2163fc47c134 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:22.062304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150592-ef58-4715-9eb9-2163fc47c134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:22.089682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-96150592-ef58-4715-9eb9-2163fc47c134 None None] MFA Rules not processed for user `48905040242a4a99bdb7344b83fa3d52`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:22.090909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-96150592-ef58-4715-9eb9-2163fc47c134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:22.164061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1319/2660] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:22.175183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd952d-fa9a-46b6-b573-39ee951b917c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:22.177026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-afcd952d-fa9a-46b6-b573-39ee951b917c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:22.235635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd952d-fa9a-46b6-b573-39ee951b917c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:22.239399 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbffc07-f20f-4a63-9229-ef987521d14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:22.240101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbffc07-f20f-4a63-9229-ef987521d14a service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:22.240384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbffc07-f20f-4a63-9229-ef987521d14a service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:22.240657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbffc07-f20f-4a63-9229-ef987521d14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:22.250133 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbffc07-f20f-4a63-9229-ef987521d14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:22.251608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbffc07-f20f-4a63-9229-ef987521d14a service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:22.261182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1342/2661] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:22.410228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96150592-ef58-4715-9eb9-2163fc47c134 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:22.475998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96150592-ef58-4715-9eb9-2163fc47c134 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:22.481159 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:22.482054 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:22.482365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:22.482636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] PATH_INFO: `/v3/users/ae2e3750e39e4ee89cb4e174bb08e2a2` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:22.484041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2e3750e39e4ee89cb4e174bb08e2a2)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:22.486298 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:22.538995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2e3750e39e4ee89cb4e174bb08e2a2'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:22.550938 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2e3750e39e4ee89cb4e174bb08e2a2'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:22.551670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2e3750e39e4ee89cb4e174bb08e2a2'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:22.560523 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2e3750e39e4ee89cb4e174bb08e2a2'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:22.561164 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2e3750e39e4ee89cb4e174bb08e2a2'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:22.574287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1320/2662] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:22 2022] DELETE /identity/v3/users/ae2e3750e39e4ee89cb4e174bb08e2a2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:22.579246 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb903246-44ea-4cbf-9917-17296da98bd6 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:22.579709 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb903246-44ea-4cbf-9917-17296da98bd6 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:22.579824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb903246-44ea-4cbf-9917-17296da98bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:22.598613 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-eb903246-44ea-4cbf-9917-17296da98bd6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:22.599811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-eb903246-44ea-4cbf-9917-17296da98bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:22.660615 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1343/2663] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:22.671243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:22.672886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:22.733683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2dcc0-9ac4-4279-a282-9ec5bc2c29fa admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:22.737715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106fe4f-fb7a-4769-8bf4-a75d7808f463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:22.738394 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106fe4f-fb7a-4769-8bf4-a75d7808f463 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:22.738676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106fe4f-fb7a-4769-8bf4-a75d7808f463 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:22.738945 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106fe4f-fb7a-4769-8bf4-a75d7808f463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:22.748064 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106fe4f-fb7a-4769-8bf4-a75d7808f463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:22.749503 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106fe4f-fb7a-4769-8bf4-a75d7808f463 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:22.758816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1321/2664] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:23.027331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb903246-44ea-4cbf-9917-17296da98bd6 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:23.028783 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-eb903246-44ea-4cbf-9917-17296da98bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:23.040817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb903246-44ea-4cbf-9917-17296da98bd6 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:23.046400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:23.047313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:23.047598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:23.047929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] PATH_INFO: `/v3/projects/a3cbdf21fb084e8e97b9c7b0038ad940` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:23.049157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3cbdf21fb084e8e97b9c7b0038ad940)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:23.051222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:23.099405 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3cbdf21fb084e8e97b9c7b0038ad940', 'request_id': 'req-02a1c24d-930b-4c6d-b299-57d2a00bbea5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.105492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3cbdf21fb084e8e97b9c7b0038ad940', 'request_id': 'req-02a1c24d-930b-4c6d-b299-57d2a00bbea5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.113792 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3cbdf21fb084e8e97b9c7b0038ad940', 'request_id': 'req-02a1c24d-930b-4c6d-b299-57d2a00bbea5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.123739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] The token cache is being invalidate because project a3cbdf21fb084e8e97b9c7b0038ad940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:23.124024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.124687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.126305 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1344/2665] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:23 2022] DELETE /identity/v3/projects/a3cbdf21fb084e8e97b9c7b0038ad940 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:59:23.130457 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106fe4f-fb7a-4769-8bf4-a75d7808f463 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:23.143792 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106fe4f-fb7a-4769-8bf4-a75d7808f463 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:23.209775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:23.210679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:23.210959 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:23.211334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] PATH_INFO: `/v3/users/48905040242a4a99bdb7344b83fa3d52` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:23.212425 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48905040242a4a99bdb7344b83fa3d52)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:23.214382 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:23.266717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48905040242a4a99bdb7344b83fa3d52'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.278986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48905040242a4a99bdb7344b83fa3d52'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.279778 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48905040242a4a99bdb7344b83fa3d52'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.288305 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48905040242a4a99bdb7344b83fa3d52'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.289480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48905040242a4a99bdb7344b83fa3d52'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.302022 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1322/2666] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:23 2022] DELETE /identity/v3/users/48905040242a4a99bdb7344b83fa3d52 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:59:23.363344 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:23.364877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:23.423932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c24d-930b-4c6d-b299-57d2a00bbea5 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:23.474756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02308cab-1189-4c3e-ad70-6bff98ed8a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:23.475421 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02308cab-1189-4c3e-ad70-6bff98ed8a73 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:23.475704 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02308cab-1189-4c3e-ad70-6bff98ed8a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:23.475973 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02308cab-1189-4c3e-ad70-6bff98ed8a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:23.478109 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-02308cab-1189-4c3e-ad70-6bff98ed8a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:23.541158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02308cab-1189-4c3e-ad70-6bff98ed8a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:23.543014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02308cab-1189-4c3e-ad70-6bff98ed8a73 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:23.552924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1345/2667] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:23.645526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:23.647225 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:23.661668 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cd362-ef55-432a-a433-75c0c6c0a73d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:23.668651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:23.669547 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:23.669804 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:23.670278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] PATH_INFO: `/v3/projects/eba0f9036b504b0091e6ffc38f087c87` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:23.671772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba0f9036b504b0091e6ffc38f087c87)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:23.674323 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:23.723699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba0f9036b504b0091e6ffc38f087c87', 'request_id': 'req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.730024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba0f9036b504b0091e6ffc38f087c87', 'request_id': 'req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.738920 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba0f9036b504b0091e6ffc38f087c87', 'request_id': 'req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.749573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] The token cache is being invalidate because project eba0f9036b504b0091e6ffc38f087c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:23.749865 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.750679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5a1d3754-ed8e-41ee-9a80-481bf4d5b33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:23.752795 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1323/2668] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:23 2022] DELETE /identity/v3/projects/eba0f9036b504b0091e6ffc38f087c87 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:23.757159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ae072-6662-48ab-94d3-605f08052c04 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:23.757630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ae072-6662-48ab-94d3-605f08052c04 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:23.757724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ae072-6662-48ab-94d3-605f08052c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:23.774721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6a4ae072-6662-48ab-94d3-605f08052c04 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:23.775909 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6a4ae072-6662-48ab-94d3-605f08052c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:23.836226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1346/2669] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:23.844151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c1852-040d-4638-875e-d5671a8f11fa None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:23.844439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c1852-040d-4638-875e-d5671a8f11fa None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:23.844766 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c1852-040d-4638-875e-d5671a8f11fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:23.863226 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e42c1852-040d-4638-875e-d5671a8f11fa None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:23.864450 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e42c1852-040d-4638-875e-d5671a8f11fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:23.872485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1324/2670] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:59:23.876819 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ae072-6662-48ab-94d3-605f08052c04 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:23.886402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ae072-6662-48ab-94d3-605f08052c04 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:23.890926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99907ba-27b8-4181-8ebc-74fd2a36c6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:23.891579 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99907ba-27b8-4181-8ebc-74fd2a36c6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:23.892021 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99907ba-27b8-4181-8ebc-74fd2a36c6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:23.892447 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99907ba-27b8-4181-8ebc-74fd2a36c6f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:23.893214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99907ba-27b8-4181-8ebc-74fd2a36c6f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:23.893515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99907ba-27b8-4181-8ebc-74fd2a36c6f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:23.895159 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99907ba-27b8-4181-8ebc-74fd2a36c6f6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:23.906614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1347/2671] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:23.911117 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c1852-040d-4638-875e-d5671a8f11fa None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:23.921114 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c1852-040d-4638-875e-d5671a8f11fa None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:23.926423 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fae6a-589b-4da9-916a-4eb4f68071ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:23.927081 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fae6a-589b-4da9-916a-4eb4f68071ab admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:23.927380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fae6a-589b-4da9-916a-4eb4f68071ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:23.927648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fae6a-589b-4da9-916a-4eb4f68071ab admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:23.928334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fae6a-589b-4da9-916a-4eb4f68071ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:23.930278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fae6a-589b-4da9-916a-4eb4f68071ab admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:23.957850 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1325/2672] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:23 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:23.962443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99907ba-27b8-4181-8ebc-74fd2a36c6f6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:23.972236 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99907ba-27b8-4181-8ebc-74fd2a36c6f6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.027351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a17d1e-205d-4826-bed7-2e61a1dfa630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.028105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17d1e-205d-4826-bed7-2e61a1dfa630 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.028384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17d1e-205d-4826-bed7-2e61a1dfa630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.028688 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17d1e-205d-4826-bed7-2e61a1dfa630 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.029523 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a17d1e-205d-4826-bed7-2e61a1dfa630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.031500 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a17d1e-205d-4826-bed7-2e61a1dfa630 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.053162 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1348/2673] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:23 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:59:24.057693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fae6a-589b-4da9-916a-4eb4f68071ab admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:24.068079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fae6a-589b-4da9-916a-4eb4f68071ab admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.072961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c078d-7b3f-4ba9-a2ad-6c88e3e1c546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.073630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c078d-7b3f-4ba9-a2ad-6c88e3e1c546 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.073913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c078d-7b3f-4ba9-a2ad-6c88e3e1c546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.074352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c078d-7b3f-4ba9-a2ad-6c88e3e1c546 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.075090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c078d-7b3f-4ba9-a2ad-6c88e3e1c546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.076695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c078d-7b3f-4ba9-a2ad-6c88e3e1c546 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.087184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1326/2674] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:24.091383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a17d1e-205d-4826-bed7-2e61a1dfa630 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:24.101461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a17d1e-205d-4826-bed7-2e61a1dfa630 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.105957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f16a4-8099-42ca-a320-b7ab3bd0c5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.106660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f16a4-8099-42ca-a320-b7ab3bd0c5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.106943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f16a4-8099-42ca-a320-b7ab3bd0c5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.107217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f16a4-8099-42ca-a320-b7ab3bd0c5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.108000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f16a4-8099-42ca-a320-b7ab3bd0c5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.109610 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f16a4-8099-42ca-a320-b7ab3bd0c5f1 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.119531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1349/2675] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:24.123917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c078d-7b3f-4ba9-a2ad-6c88e3e1c546 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:24.135748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c078d-7b3f-4ba9-a2ad-6c88e3e1c546 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.145170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3051-fc98-464d-b660-c2ffd2bd94ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.146007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3051-fc98-464d-b660-c2ffd2bd94ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.146322 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3051-fc98-464d-b660-c2ffd2bd94ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.146591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3051-fc98-464d-b660-c2ffd2bd94ca admin admin] PATH_INFO: `/v3/projects/7716931a131d412590a34fa7aee22f5c/users/7e9b81d7909845bba20930372164cc54/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.161998 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3051-fc98-464d-b660-c2ffd2bd94ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7716931a131d412590a34fa7aee22f5c, user_id=7e9b81d7909845bba20930372164cc54, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.164912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3051-fc98-464d-b660-c2ffd2bd94ca admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.180065 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1327/2676] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:24 2022] PUT /identity/v3/projects/7716931a131d412590a34fa7aee22f5c/users/7e9b81d7909845bba20930372164cc54/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:24.191116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062aaae-96a9-4d1d-b74e-11c9be9624a7 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.191116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062aaae-96a9-4d1d-b74e-11c9be9624a7 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.191358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062aaae-96a9-4d1d-b74e-11c9be9624a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.217904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-1062aaae-96a9-4d1d-b74e-11c9be9624a7 None None] MFA Rules not processed for user `7e9b81d7909845bba20930372164cc54`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:24.219149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-1062aaae-96a9-4d1d-b74e-11c9be9624a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:24.282570 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1350/2677] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:24.287272 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3051-fc98-464d-b660-c2ffd2bd94ca admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:24.348222 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3051-fc98-464d-b660-c2ffd2bd94ca admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.353624 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a350-5ded-4b85-8ff0-938ad45b76ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.354316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a350-5ded-4b85-8ff0-938ad45b76ce admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.354591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a350-5ded-4b85-8ff0-938ad45b76ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.354855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a350-5ded-4b85-8ff0-938ad45b76ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.355698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602a350-5ded-4b85-8ff0-938ad45b76ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.357657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602a350-5ded-4b85-8ff0-938ad45b76ce admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.383575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1328/2678] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:24 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:24.387741 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062aaae-96a9-4d1d-b74e-11c9be9624a7 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:24.398619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062aaae-96a9-4d1d-b74e-11c9be9624a7 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.458041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b2933-38a5-462e-8dc0-c92c0cd0b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.458765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2933-38a5-462e-8dc0-c92c0cd0b4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.459049 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2933-38a5-462e-8dc0-c92c0cd0b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.459327 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2933-38a5-462e-8dc0-c92c0cd0b4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.460097 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b2933-38a5-462e-8dc0-c92c0cd0b4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.462105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b2933-38a5-462e-8dc0-c92c0cd0b4e7 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.491383 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1351/2679] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:24 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:24.495433 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a350-5ded-4b85-8ff0-938ad45b76ce admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:24.512961 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a350-5ded-4b85-8ff0-938ad45b76ce admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.518022 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a91b45-e732-4519-9048-d7a70dde782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.518796 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a91b45-e732-4519-9048-d7a70dde782f admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.519142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a91b45-e732-4519-9048-d7a70dde782f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.519467 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a91b45-e732-4519-9048-d7a70dde782f admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.520259 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a91b45-e732-4519-9048-d7a70dde782f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.522136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a91b45-e732-4519-9048-d7a70dde782f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.535976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1329/2680] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:24.540071 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b2933-38a5-462e-8dc0-c92c0cd0b4e7 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:24.551431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b2933-38a5-462e-8dc0-c92c0cd0b4e7 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.556362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10d1d2-fdba-4948-94cb-cefacb51e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.557456 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10d1d2-fdba-4948-94cb-cefacb51e133 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.557737 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10d1d2-fdba-4948-94cb-cefacb51e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.558008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10d1d2-fdba-4948-94cb-cefacb51e133 admin admin] PATH_INFO: `/v3/projects/677c09fc6e4f43289cd8c2cc170121d8/users/fe8666dd23914095ad333fc866164310/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.583230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10d1d2-fdba-4948-94cb-cefacb51e133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=677c09fc6e4f43289cd8c2cc170121d8, user_id=fe8666dd23914095ad333fc866164310, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.586224 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10d1d2-fdba-4948-94cb-cefacb51e133 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.604079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1352/2681] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:24 2022] PUT /identity/v3/projects/677c09fc6e4f43289cd8c2cc170121d8/users/fe8666dd23914095ad333fc866164310/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:59:24.608487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a91b45-e732-4519-9048-d7a70dde782f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:24.621101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a91b45-e732-4519-9048-d7a70dde782f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.678381 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80089450-86d0-4791-8382-810aeb2f4174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.679046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80089450-86d0-4791-8382-810aeb2f4174 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.679278 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80089450-86d0-4791-8382-810aeb2f4174 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.679556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80089450-86d0-4791-8382-810aeb2f4174 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.680312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80089450-86d0-4791-8382-810aeb2f4174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.681922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80089450-86d0-4791-8382-810aeb2f4174 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.691831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1330/2682] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:24.696296 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10d1d2-fdba-4948-94cb-cefacb51e133 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:24.706525 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10d1d2-fdba-4948-94cb-cefacb51e133 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.711125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153acfa-93d0-460e-9a90-1c8e7222136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.712089 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153acfa-93d0-460e-9a90-1c8e7222136b admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.712292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153acfa-93d0-460e-9a90-1c8e7222136b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.712564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153acfa-93d0-460e-9a90-1c8e7222136b admin admin] PATH_INFO: `/v3/projects/677c09fc6e4f43289cd8c2cc170121d8/users/fe8666dd23914095ad333fc866164310/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.714551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153acfa-93d0-460e-9a90-1c8e7222136b admin admin] RBAC: Authorizing `identity:create_grant(project_id=677c09fc6e4f43289cd8c2cc170121d8, user_id=fe8666dd23914095ad333fc866164310, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.717362 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153acfa-93d0-460e-9a90-1c8e7222136b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.728078 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1353/2683] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:24 2022] PUT /identity/v3/projects/677c09fc6e4f43289cd8c2cc170121d8/users/fe8666dd23914095ad333fc866164310/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:24.739584 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5859fc-d0af-4138-b64a-946bed1d59e8 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.739874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5859fc-d0af-4138-b64a-946bed1d59e8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.740291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5859fc-d0af-4138-b64a-946bed1d59e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.766394 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ff5859fc-d0af-4138-b64a-946bed1d59e8 None None] MFA Rules not processed for user `fe8666dd23914095ad333fc866164310`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:24.767602 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ff5859fc-d0af-4138-b64a-946bed1d59e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:24.836941 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1331/2684] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:24.848228 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153acfa-93d0-460e-9a90-1c8e7222136b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:24.850199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f153acfa-93d0-460e-9a90-1c8e7222136b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:24.905998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153acfa-93d0-460e-9a90-1c8e7222136b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:24.911513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac214024-1a4a-41b9-b005-d8c6907b4d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:24.912041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac214024-1a4a-41b9-b005-d8c6907b4d61 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.912328 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac214024-1a4a-41b9-b005-d8c6907b4d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.912602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac214024-1a4a-41b9-b005-d8c6907b4d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.976157 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac214024-1a4a-41b9-b005-d8c6907b4d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:24.977738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac214024-1a4a-41b9-b005-d8c6907b4d61 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:24.987588 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1354/2685] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:26.662240 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5859fc-d0af-4138-b64a-946bed1d59e8 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:26.663713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ff5859fc-d0af-4138-b64a-946bed1d59e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:26.715123 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac214024-1a4a-41b9-b005-d8c6907b4d61 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:26.716656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ac214024-1a4a-41b9-b005-d8c6907b4d61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:26.736072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5859fc-d0af-4138-b64a-946bed1d59e8 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:26.741236 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf95cc-eaae-4cb2-b824-c5548f40c611 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:26.741953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf95cc-eaae-4cb2-b824-c5548f40c611 service placement] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:26.742337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf95cc-eaae-4cb2-b824-c5548f40c611 service placement] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:26.742612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf95cc-eaae-4cb2-b824-c5548f40c611 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:26.744381 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-22bf95cc-eaae-4cb2-b824-c5548f40c611 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:26.756007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf95cc-eaae-4cb2-b824-c5548f40c611 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:26.757754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf95cc-eaae-4cb2-b824-c5548f40c611 service placement] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:26.769638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1332/2686] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:26.781045 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac214024-1a4a-41b9-b005-d8c6907b4d61 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:26.785687 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:26.786597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:26.786829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:26.787096 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] PATH_INFO: `/v3/users/36c4bc5fb79b455fba3c684645fca939` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:26.788280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c4bc5fb79b455fba3c684645fca939)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:26.790287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:26.837794 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c4bc5fb79b455fba3c684645fca939'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:26.849632 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c4bc5fb79b455fba3c684645fca939'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:26.850435 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c4bc5fb79b455fba3c684645fca939'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:26.851320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c4bc5fb79b455fba3c684645fca939'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:26.859443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-4d6e05f1-071b-4f6f-8695-406bc291c71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c4bc5fb79b455fba3c684645fca939'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:26.871309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1355/2687] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:26 2022] DELETE /identity/v3/users/36c4bc5fb79b455fba3c684645fca939 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:59:27.049402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf95cc-eaae-4cb2-b824-c5548f40c611 service placement] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:27.062484 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf95cc-eaae-4cb2-b824-c5548f40c611 service placement] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:27.120262 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:27.121127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.121405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.121671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] PATH_INFO: `/v3/projects/36f8887e8f7f4c038d11cb582b95c2e8` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.122914 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f8887e8f7f4c038d11cb582b95c2e8)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:27.124819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:27.171490 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f8887e8f7f4c038d11cb582b95c2e8', 'request_id': 'req-f70edfea-9e60-492c-9a17-4584b79dd9ff'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:27.178032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f8887e8f7f4c038d11cb582b95c2e8', 'request_id': 'req-f70edfea-9e60-492c-9a17-4584b79dd9ff'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:27.187889 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f8887e8f7f4c038d11cb582b95c2e8', 'request_id': 'req-f70edfea-9e60-492c-9a17-4584b79dd9ff'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:27.198370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] The token cache is being invalidate because project 36f8887e8f7f4c038d11cb582b95c2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:27.198651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:27.199270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f70edfea-9e60-492c-9a17-4584b79dd9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:27.200806 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1333/2688] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:27 2022] DELETE /identity/v3/projects/36f8887e8f7f4c038d11cb582b95c2e8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:27.207064 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25be9d4-ca11-4c4d-80f5-eab1643e032d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.207397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25be9d4-ca11-4c4d-80f5-eab1643e032d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.207757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25be9d4-ca11-4c4d-80f5-eab1643e032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.227044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-e25be9d4-ca11-4c4d-80f5-eab1643e032d None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:27.228233 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e25be9d4-ca11-4c4d-80f5-eab1643e032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:27.296189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1356/2689] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:27.306825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b617-17dc-4bd4-8d0c-97093fe6225c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.307113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b617-17dc-4bd4-8d0c-97093fe6225c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.307388 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b617-17dc-4bd4-8d0c-97093fe6225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.326339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d467b617-17dc-4bd4-8d0c-97093fe6225c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:27.327594 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d467b617-17dc-4bd4-8d0c-97093fe6225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:27.336364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1334/2690] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:27.340724 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25be9d4-ca11-4c4d-80f5-eab1643e032d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:27.350797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25be9d4-ca11-4c4d-80f5-eab1643e032d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:27.356367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2032056-2dbc-4921-8422-5979b7af68f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:27.357023 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2032056-2dbc-4921-8422-5979b7af68f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.357292 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2032056-2dbc-4921-8422-5979b7af68f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.357561 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2032056-2dbc-4921-8422-5979b7af68f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.358319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2032056-2dbc-4921-8422-5979b7af68f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:27.358621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2032056-2dbc-4921-8422-5979b7af68f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:27.360209 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2032056-2dbc-4921-8422-5979b7af68f4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:27.371682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1357/2691] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:27.378234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467b617-17dc-4bd4-8d0c-97093fe6225c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:27.392132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467b617-17dc-4bd4-8d0c-97093fe6225c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:27.399917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e4475-5762-41c2-990c-db4cc7601bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:27.400570 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e4475-5762-41c2-990c-db4cc7601bfc admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.400857 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e4475-5762-41c2-990c-db4cc7601bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.401129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e4475-5762-41c2-990c-db4cc7601bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.401830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e4475-5762-41c2-990c-db4cc7601bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:27.403782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e4475-5762-41c2-990c-db4cc7601bfc admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:27.432645 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1335/2692] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:27 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:27.438592 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2032056-2dbc-4921-8422-5979b7af68f4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:27.448814 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2032056-2dbc-4921-8422-5979b7af68f4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:27.507408 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd4f3-ccf8-436d-bc26-5cf1dca278f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:27.508077 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd4f3-ccf8-436d-bc26-5cf1dca278f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.508346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd4f3-ccf8-436d-bc26-5cf1dca278f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.508602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd4f3-ccf8-436d-bc26-5cf1dca278f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.509285 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd4f3-ccf8-436d-bc26-5cf1dca278f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:27.511237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd4f3-ccf8-436d-bc26-5cf1dca278f4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:27.534464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1358/2693] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:27 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:59:27.540246 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e4475-5762-41c2-990c-db4cc7601bfc admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:27.551511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e4475-5762-41c2-990c-db4cc7601bfc admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:27.556609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e61f2-12d6-4a3a-b4aa-7d68eb6bff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:27.557273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e61f2-12d6-4a3a-b4aa-7d68eb6bff45 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.557555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e61f2-12d6-4a3a-b4aa-7d68eb6bff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.557852 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e61f2-12d6-4a3a-b4aa-7d68eb6bff45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.558662 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e61f2-12d6-4a3a-b4aa-7d68eb6bff45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:27.560268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e61f2-12d6-4a3a-b4aa-7d68eb6bff45 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:27.570960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1336/2694] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:27.574883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd4f3-ccf8-436d-bc26-5cf1dca278f4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:27.586108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd4f3-ccf8-436d-bc26-5cf1dca278f4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:27.591158 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928b9f8-dbb6-42fe-becc-4fa072262977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:27.591826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928b9f8-dbb6-42fe-becc-4fa072262977 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.592082 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928b9f8-dbb6-42fe-becc-4fa072262977 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.592386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928b9f8-dbb6-42fe-becc-4fa072262977 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.593098 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928b9f8-dbb6-42fe-becc-4fa072262977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:27.594750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928b9f8-dbb6-42fe-becc-4fa072262977 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:27.607384 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1359/2695] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:27.611730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e61f2-12d6-4a3a-b4aa-7d68eb6bff45 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:27.621696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e61f2-12d6-4a3a-b4aa-7d68eb6bff45 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:27.626853 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4617c1a-97a4-4346-b1f3-c47526630f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:27.627740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4617c1a-97a4-4346-b1f3-c47526630f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.628015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4617c1a-97a4-4346-b1f3-c47526630f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.628285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4617c1a-97a4-4346-b1f3-c47526630f83 admin admin] PATH_INFO: `/v3/projects/85f6535669e54d06b11a6a4c37f07cb4/users/8b88c647679b404d9d9ae17890ef10fe/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.647424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4617c1a-97a4-4346-b1f3-c47526630f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f6535669e54d06b11a6a4c37f07cb4, user_id=8b88c647679b404d9d9ae17890ef10fe, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:27.650027 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4617c1a-97a4-4346-b1f3-c47526630f83 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:27.668066 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1337/2696] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:27 2022] PUT /identity/v3/projects/85f6535669e54d06b11a6a4c37f07cb4/users/8b88c647679b404d9d9ae17890ef10fe/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:27.673331 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc362a84-d28d-4a23-b62b-5098932dd97c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.673624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc362a84-d28d-4a23-b62b-5098932dd97c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.673900 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc362a84-d28d-4a23-b62b-5098932dd97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.695264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-cc362a84-d28d-4a23-b62b-5098932dd97c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:27.696491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-cc362a84-d28d-4a23-b62b-5098932dd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:27.755184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1360/2697] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:27.765906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4617c1a-97a4-4346-b1f3-c47526630f83 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:27.767943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f4617c1a-97a4-4346-b1f3-c47526630f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:27.824811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4617c1a-97a4-4346-b1f3-c47526630f83 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:27.828989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04bed9-3846-4b52-8300-31d2d033e8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:27.829637 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04bed9-3846-4b52-8300-31d2d033e8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:27.829880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04bed9-3846-4b52-8300-31d2d033e8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:27.830216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04bed9-3846-4b52-8300-31d2d033e8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:27.840263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04bed9-3846-4b52-8300-31d2d033e8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:27.841698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04bed9-3846-4b52-8300-31d2d033e8a6 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:27.851549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1338/2698] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:59:29.674173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc362a84-d28d-4a23-b62b-5098932dd97c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:29.676214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-cc362a84-d28d-4a23-b62b-5098932dd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:29.737069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc362a84-d28d-4a23-b62b-5098932dd97c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:29.743656 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d58229-c7bc-4ece-a152-ee1e6c0bc1e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:29.744520 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d58229-c7bc-4ece-a152-ee1e6c0bc1e2 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:29.744975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d58229-c7bc-4ece-a152-ee1e6c0bc1e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:29.745257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d58229-c7bc-4ece-a152-ee1e6c0bc1e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:29.747423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-72d58229-c7bc-4ece-a152-ee1e6c0bc1e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:29.827935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d58229-c7bc-4ece-a152-ee1e6c0bc1e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:29.829686 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d58229-c7bc-4ece-a152-ee1e6c0bc1e2 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:29.844116 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1361/2699] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:31.519368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1a1fb-8f0f-4a65-b64d-3fd92fd79233 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:31.519869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1a1fb-8f0f-4a65-b64d-3fd92fd79233 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:31.519964 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1a1fb-8f0f-4a65-b64d-3fd92fd79233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:31.551528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-80f1a1fb-8f0f-4a65-b64d-3fd92fd79233 None None] MFA Rules not processed for user `8b88c647679b404d9d9ae17890ef10fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:31.552681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-80f1a1fb-8f0f-4a65-b64d-3fd92fd79233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:31.616370 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1339/2700] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:31.630708 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d58229-c7bc-4ece-a152-ee1e6c0bc1e2 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:31.633197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-72d58229-c7bc-4ece-a152-ee1e6c0bc1e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:31.732321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d58229-c7bc-4ece-a152-ee1e6c0bc1e2 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:31.743145 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f264a6e-9add-4717-b096-807f847dac70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:31.743926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264a6e-9add-4717-b096-807f847dac70 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:31.744266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264a6e-9add-4717-b096-807f847dac70 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:31.744723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264a6e-9add-4717-b096-807f847dac70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:31.753086 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f264a6e-9add-4717-b096-807f847dac70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:31.754726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f264a6e-9add-4717-b096-807f847dac70 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:31.778410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1362/2701] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:33.056878 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835ee1-0705-4014-8c6b-b6308a330327 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:33.057469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835ee1-0705-4014-8c6b-b6308a330327 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:33.057469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835ee1-0705-4014-8c6b-b6308a330327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:33.075170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e0835ee1-0705-4014-8c6b-b6308a330327 None None] MFA Rules not processed for user `8b88c647679b404d9d9ae17890ef10fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:33.076363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e0835ee1-0705-4014-8c6b-b6308a330327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:33.083509 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1340/2702] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:50.916023 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f264a6e-9add-4717-b096-807f847dac70 service nova] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:50.918111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4f264a6e-9add-4717-b096-807f847dac70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:50.932550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f264a6e-9add-4717-b096-807f847dac70 service nova] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:50.937872 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:50.938826 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:50.939105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:50.939379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] PATH_INFO: `/v3/users/7e9b81d7909845bba20930372164cc54` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:50.940617 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9b81d7909845bba20930372164cc54)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:50.942574 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:50.989854 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9b81d7909845bba20930372164cc54'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.001895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9b81d7909845bba20930372164cc54'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.002661 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9b81d7909845bba20930372164cc54'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.003274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9b81d7909845bba20930372164cc54'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.011423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9b81d7909845bba20930372164cc54'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.023332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1363/2703] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:50 2022] DELETE /identity/v3/users/7e9b81d7909845bba20930372164cc54 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:51.027857 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d3246-095d-4058-9e95-236e0cd66c21 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:51.028359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d3246-095d-4058-9e95-236e0cd66c21 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:51.028458 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d3246-095d-4058-9e95-236e0cd66c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:51.046075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-a35d3246-095d-4058-9e95-236e0cd66c21 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:51.047479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a35d3246-095d-4058-9e95-236e0cd66c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:51.107557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1341/2704] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:51.118004 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:51.120060 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:51.178963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9743afb-1598-44ae-8108-4a7910ee0c5b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:51.182608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13b219-67aa-4e57-b2a0-3924da86839f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:51.183264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13b219-67aa-4e57-b2a0-3924da86839f service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:51.183547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13b219-67aa-4e57-b2a0-3924da86839f service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:51.183821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13b219-67aa-4e57-b2a0-3924da86839f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:51.193002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13b219-67aa-4e57-b2a0-3924da86839f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:51.194484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13b219-67aa-4e57-b2a0-3924da86839f service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:51.203775 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1364/2705] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:51.618851 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d3246-095d-4058-9e95-236e0cd66c21 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:51.620328 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a35d3246-095d-4058-9e95-236e0cd66c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:51.633858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d3246-095d-4058-9e95-236e0cd66c21 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:51.659987 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:51.661008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:51.661332 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:51.661670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] PATH_INFO: `/v3/projects/7716931a131d412590a34fa7aee22f5c` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:51.663121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7716931a131d412590a34fa7aee22f5c)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:51.665106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:51.713767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7716931a131d412590a34fa7aee22f5c', 'request_id': 'req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.720131 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7716931a131d412590a34fa7aee22f5c', 'request_id': 'req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.729331 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7716931a131d412590a34fa7aee22f5c', 'request_id': 'req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.739922 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] The token cache is being invalidate because project 7716931a131d412590a34fa7aee22f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:51.740203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.740840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.742451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1342/2706] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:51 2022] DELETE /identity/v3/projects/7716931a131d412590a34fa7aee22f5c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:51.746726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13b219-67aa-4e57-b2a0-3924da86839f service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:51.755987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13b219-67aa-4e57-b2a0-3924da86839f service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:51.813838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:51.814764 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:51.815040 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:51.815313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] PATH_INFO: `/v3/users/fe8666dd23914095ad333fc866164310` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:51.816499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8666dd23914095ad333fc866164310)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:51.818437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:51.872625 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8666dd23914095ad333fc866164310'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.884585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8666dd23914095ad333fc866164310'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.885459 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8666dd23914095ad333fc866164310'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.886183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8666dd23914095ad333fc866164310'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.896730 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-12d873e8-c956-449f-9a2a-aeb51c629fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8666dd23914095ad333fc866164310'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:51.910804 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1365/2707] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:51 2022] DELETE /identity/v3/users/fe8666dd23914095ad333fc866164310 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:59:52.322255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:52.324264 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:52.343159 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cebdd6-721a-40a1-89bc-ab9f42e3e49d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:52.405541 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:52.407024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:52.407363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:52.407644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] PATH_INFO: `/v3/projects/677c09fc6e4f43289cd8c2cc170121d8` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:52.409040 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=677c09fc6e4f43289cd8c2cc170121d8)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:52.411512 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:52.469084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677c09fc6e4f43289cd8c2cc170121d8', 'request_id': 'req-5e589d06-0eb8-45d1-8505-de3af871bc3b'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:52.475657 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677c09fc6e4f43289cd8c2cc170121d8', 'request_id': 'req-5e589d06-0eb8-45d1-8505-de3af871bc3b'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:52.486522 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677c09fc6e4f43289cd8c2cc170121d8', 'request_id': 'req-5e589d06-0eb8-45d1-8505-de3af871bc3b'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:52.498427 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] The token cache is being invalidate because project 677c09fc6e4f43289cd8c2cc170121d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:52.500040 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:52.500865 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5e589d06-0eb8-45d1-8505-de3af871bc3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:52.503995 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1343/2708] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:52 2022] DELETE /identity/v3/projects/677c09fc6e4f43289cd8c2cc170121d8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:52.510357 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4651-3bc9-4713-a204-dc9d172fb202 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:52.511309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4651-3bc9-4713-a204-dc9d172fb202 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:52.511895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4651-3bc9-4713-a204-dc9d172fb202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:52.530670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-3e1d4651-3bc9-4713-a204-dc9d172fb202 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:52.532134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3e1d4651-3bc9-4713-a204-dc9d172fb202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:52.593505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1366/2709] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:59:52.601681 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f380d5a-fed4-4543-8739-406cf8fc6c56 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:52.601965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f380d5a-fed4-4543-8739-406cf8fc6c56 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:52.602271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f380d5a-fed4-4543-8739-406cf8fc6c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:52.620680 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-1f380d5a-fed4-4543-8739-406cf8fc6c56 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:52.621906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-1f380d5a-fed4-4543-8739-406cf8fc6c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:52.630127 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1344/2710] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:52.635431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4651-3bc9-4713-a204-dc9d172fb202 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:52.653283 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4651-3bc9-4713-a204-dc9d172fb202 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:52.658055 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bebbe-92a5-4f15-a003-8515882966e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:52.658763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bebbe-92a5-4f15-a003-8515882966e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:52.659046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bebbe-92a5-4f15-a003-8515882966e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:52.659353 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bebbe-92a5-4f15-a003-8515882966e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:52.660068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bebbe-92a5-4f15-a003-8515882966e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:52.660374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bebbe-92a5-4f15-a003-8515882966e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:52.661988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bebbe-92a5-4f15-a003-8515882966e0 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:52.678270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1367/2711] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:52.679419 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f380d5a-fed4-4543-8739-406cf8fc6c56 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:52.689043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f380d5a-fed4-4543-8739-406cf8fc6c56 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:52.693784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0a095-f32d-4452-9be2-f5182b679944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:52.694470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0a095-f32d-4452-9be2-f5182b679944 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:52.694749 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0a095-f32d-4452-9be2-f5182b679944 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:52.695021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0a095-f32d-4452-9be2-f5182b679944 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:52.695719 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0a095-f32d-4452-9be2-f5182b679944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:52.697782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0a095-f32d-4452-9be2-f5182b679944 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:52.728187 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1345/2712] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:52 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:59:52.729390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bebbe-92a5-4f15-a003-8515882966e0 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:52.739387 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bebbe-92a5-4f15-a003-8515882966e0 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:52.796655 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35deace0-c6e1-47ed-8e2d-a4224546f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:52.797341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deace0-c6e1-47ed-8e2d-a4224546f3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:52.797737 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deace0-c6e1-47ed-8e2d-a4224546f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:52.798122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deace0-c6e1-47ed-8e2d-a4224546f3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:52.798822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35deace0-c6e1-47ed-8e2d-a4224546f3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:52.800777 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35deace0-c6e1-47ed-8e2d-a4224546f3a8 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:52.823961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1368/2713] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:52 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:59:52.828153 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0a095-f32d-4452-9be2-f5182b679944 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:52.839065 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0a095-f32d-4452-9be2-f5182b679944 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:52.843609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ba1e3-5747-410f-b760-6a5609bfbc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:52.844277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ba1e3-5747-410f-b760-6a5609bfbc2d admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:52.844558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ba1e3-5747-410f-b760-6a5609bfbc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:52.844904 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ba1e3-5747-410f-b760-6a5609bfbc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:52.845634 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ba1e3-5747-410f-b760-6a5609bfbc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:52.847297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ba1e3-5747-410f-b760-6a5609bfbc2d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:52.858631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1346/2714] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:52.862753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35deace0-c6e1-47ed-8e2d-a4224546f3a8 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:52.873531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35deace0-c6e1-47ed-8e2d-a4224546f3a8 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:52.878918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08189717-f160-4481-aaf6-8f541da67618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:52.879674 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08189717-f160-4481-aaf6-8f541da67618 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:52.880038 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08189717-f160-4481-aaf6-8f541da67618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:52.880397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08189717-f160-4481-aaf6-8f541da67618 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:52.881187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08189717-f160-4481-aaf6-8f541da67618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:52.882990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08189717-f160-4481-aaf6-8f541da67618 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:52.894597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1369/2715] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:52.899086 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ba1e3-5747-410f-b760-6a5609bfbc2d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:52.909949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ba1e3-5747-410f-b760-6a5609bfbc2d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:52.915487 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc40fb-37d4-49fe-b89e-ab67363b81ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:52.920267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc40fb-37d4-49fe-b89e-ab67363b81ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:52.920545 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc40fb-37d4-49fe-b89e-ab67363b81ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:52.920823 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc40fb-37d4-49fe-b89e-ab67363b81ef admin admin] PATH_INFO: `/v3/projects/135838cb91084613bbecfca922399b76/users/8b293656c0d042dd861c6ede067a3b0d/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:52.937200 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc40fb-37d4-49fe-b89e-ab67363b81ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=135838cb91084613bbecfca922399b76, user_id=8b293656c0d042dd861c6ede067a3b0d, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:52.939887 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc40fb-37d4-49fe-b89e-ab67363b81ef admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:52.962968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1347/2716] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:52 2022] PUT /identity/v3/projects/135838cb91084613bbecfca922399b76/users/8b293656c0d042dd861c6ede067a3b0d/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:52.968124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f638fec-ea52-4a56-a641-4b682d98661e None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:52.968410 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f638fec-ea52-4a56-a641-4b682d98661e None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:52.968686 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f638fec-ea52-4a56-a641-4b682d98661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:52.995498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-4f638fec-ea52-4a56-a641-4b682d98661e None None] MFA Rules not processed for user `8b293656c0d042dd861c6ede067a3b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:52.996833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-4f638fec-ea52-4a56-a641-4b682d98661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:53.060961 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1370/2717] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:53.065746 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc40fb-37d4-49fe-b89e-ab67363b81ef admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.133253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc40fb-37d4-49fe-b89e-ab67363b81ef admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.138556 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd84229-a09e-41bb-9e50-e829c9040866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.139218 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd84229-a09e-41bb-9e50-e829c9040866 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.139494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd84229-a09e-41bb-9e50-e829c9040866 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.139785 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd84229-a09e-41bb-9e50-e829c9040866 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.140450 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd84229-a09e-41bb-9e50-e829c9040866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.142449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd84229-a09e-41bb-9e50-e829c9040866 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.169566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1348/2718] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:53 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:53.173769 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f638fec-ea52-4a56-a641-4b682d98661e None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.184642 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f638fec-ea52-4a56-a641-4b682d98661e None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.239359 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e25544-39c2-4a0b-a652-c1783735dca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.240036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e25544-39c2-4a0b-a652-c1783735dca2 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.240309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e25544-39c2-4a0b-a652-c1783735dca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.240583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e25544-39c2-4a0b-a652-c1783735dca2 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.241278 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e25544-39c2-4a0b-a652-c1783735dca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.243253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e25544-39c2-4a0b-a652-c1783735dca2 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.263635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1371/2719] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:53 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:53.268010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd84229-a09e-41bb-9e50-e829c9040866 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.281566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd84229-a09e-41bb-9e50-e829c9040866 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.287378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eee38-6622-401f-9bab-1731a86576a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.288061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eee38-6622-401f-9bab-1731a86576a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.288338 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eee38-6622-401f-9bab-1731a86576a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.288608 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eee38-6622-401f-9bab-1731a86576a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.289329 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58eee38-6622-401f-9bab-1731a86576a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.290983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58eee38-6622-401f-9bab-1731a86576a6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.302612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1349/2720] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:53.306688 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e25544-39c2-4a0b-a652-c1783735dca2 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.317506 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e25544-39c2-4a0b-a652-c1783735dca2 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.323273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f5f12-5ec9-4665-81d9-002631080386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.323927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f5f12-5ec9-4665-81d9-002631080386 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.324216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f5f12-5ec9-4665-81d9-002631080386 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.324487 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f5f12-5ec9-4665-81d9-002631080386 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.325216 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f5f12-5ec9-4665-81d9-002631080386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.326861 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f5f12-5ec9-4665-81d9-002631080386 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.336990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1372/2721] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:53.341234 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eee38-6622-401f-9bab-1731a86576a6 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.352025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eee38-6622-401f-9bab-1731a86576a6 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.357253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d51366-db01-4674-9846-e7f973099eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.358178 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d51366-db01-4674-9846-e7f973099eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.358444 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d51366-db01-4674-9846-e7f973099eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.358718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d51366-db01-4674-9846-e7f973099eaf admin admin] PATH_INFO: `/v3/projects/8dde48f85acb4e9786572e137e52ab4c/users/1527f8ab4dbe44da81fbd5528a543310/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.373992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d51366-db01-4674-9846-e7f973099eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dde48f85acb4e9786572e137e52ab4c, user_id=1527f8ab4dbe44da81fbd5528a543310, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.377133 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d51366-db01-4674-9846-e7f973099eaf admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.392980 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1350/2722] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:53 2022] PUT /identity/v3/projects/8dde48f85acb4e9786572e137e52ab4c/users/1527f8ab4dbe44da81fbd5528a543310/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:53.403659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b3214-51b8-468b-ae0b-4c514f130e7f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.403945 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b3214-51b8-468b-ae0b-4c514f130e7f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.404214 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b3214-51b8-468b-ae0b-4c514f130e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.435107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ae0b3214-51b8-468b-ae0b-4c514f130e7f None None] MFA Rules not processed for user `1527f8ab4dbe44da81fbd5528a543310`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:53.436311 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ae0b3214-51b8-468b-ae0b-4c514f130e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:53.500713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1373/2723] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:53.505374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d51366-db01-4674-9846-e7f973099eaf admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.571718 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d51366-db01-4674-9846-e7f973099eaf admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.576801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc60fb6-8e27-4951-9213-ec4a904f00b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.577453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc60fb6-8e27-4951-9213-ec4a904f00b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.577735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc60fb6-8e27-4951-9213-ec4a904f00b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.578007 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc60fb6-8e27-4951-9213-ec4a904f00b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.578730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc60fb6-8e27-4951-9213-ec4a904f00b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.580636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc60fb6-8e27-4951-9213-ec4a904f00b2 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.608770 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1351/2724] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:53 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:53.613234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b3214-51b8-468b-ae0b-4c514f130e7f None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.624533 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b3214-51b8-468b-ae0b-4c514f130e7f None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.683817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5ea2f-ec21-48b6-9cae-5ffe3911293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.684490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ea2f-ec21-48b6-9cae-5ffe3911293b admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.684773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ea2f-ec21-48b6-9cae-5ffe3911293b admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.685044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ea2f-ec21-48b6-9cae-5ffe3911293b admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.685762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5ea2f-ec21-48b6-9cae-5ffe3911293b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.687711 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5ea2f-ec21-48b6-9cae-5ffe3911293b admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.708418 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1374/2725] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:53 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:53.712572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc60fb6-8e27-4951-9213-ec4a904f00b2 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.723019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc60fb6-8e27-4951-9213-ec4a904f00b2 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.728287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f08a6e-1596-44dd-8e3a-c93997aa61de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.728957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f08a6e-1596-44dd-8e3a-c93997aa61de admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.729308 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f08a6e-1596-44dd-8e3a-c93997aa61de admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.729606 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f08a6e-1596-44dd-8e3a-c93997aa61de admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.730354 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f08a6e-1596-44dd-8e3a-c93997aa61de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.731965 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f08a6e-1596-44dd-8e3a-c93997aa61de admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.742771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1352/2726] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:53.746984 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5ea2f-ec21-48b6-9cae-5ffe3911293b admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.757963 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5ea2f-ec21-48b6-9cae-5ffe3911293b admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.763997 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d00c-f8cc-44e7-b084-0208187bd1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.764883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d00c-f8cc-44e7-b084-0208187bd1de admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.765163 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d00c-f8cc-44e7-b084-0208187bd1de admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.765437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d00c-f8cc-44e7-b084-0208187bd1de admin admin] PATH_INFO: `/v3/projects/c4da78e5758644eca12185506d4f2ecd/users/27d080633dfa4ac7b4159514034f3e7d/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.781545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671d00c-f8cc-44e7-b084-0208187bd1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4da78e5758644eca12185506d4f2ecd, user_id=27d080633dfa4ac7b4159514034f3e7d, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.784266 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671d00c-f8cc-44e7-b084-0208187bd1de admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.799417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1375/2727] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:53 2022] PUT /identity/v3/projects/c4da78e5758644eca12185506d4f2ecd/users/27d080633dfa4ac7b4159514034f3e7d/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:53.803875 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f08a6e-1596-44dd-8e3a-c93997aa61de admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.817244 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f08a6e-1596-44dd-8e3a-c93997aa61de admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.877950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8035710-c00c-4a7b-9a72-f14b7432e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.878661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8035710-c00c-4a7b-9a72-f14b7432e672 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.878936 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8035710-c00c-4a7b-9a72-f14b7432e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.879364 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8035710-c00c-4a7b-9a72-f14b7432e672 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.880636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8035710-c00c-4a7b-9a72-f14b7432e672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.883243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8035710-c00c-4a7b-9a72-f14b7432e672 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.894463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1353/2728] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:53.898802 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d00c-f8cc-44e7-b084-0208187bd1de admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:53.909036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d00c-f8cc-44e7-b084-0208187bd1de admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:53.913800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77869c06-0c99-4a43-8afd-dd73051c3d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:53.914712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77869c06-0c99-4a43-8afd-dd73051c3d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.914986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77869c06-0c99-4a43-8afd-dd73051c3d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.915255 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77869c06-0c99-4a43-8afd-dd73051c3d69 admin admin] PATH_INFO: `/v3/projects/c4da78e5758644eca12185506d4f2ecd/users/27d080633dfa4ac7b4159514034f3e7d/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.917230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77869c06-0c99-4a43-8afd-dd73051c3d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4da78e5758644eca12185506d4f2ecd, user_id=27d080633dfa4ac7b4159514034f3e7d, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:53.920264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77869c06-0c99-4a43-8afd-dd73051c3d69 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:53.930755 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1376/2729] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:53 2022] PUT /identity/v3/projects/c4da78e5758644eca12185506d4f2ecd/users/27d080633dfa4ac7b4159514034f3e7d/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:53.941355 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8193ecf-7073-406d-8855-f62051b3c187 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:53.941633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8193ecf-7073-406d-8855-f62051b3c187 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:53.941912 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8193ecf-7073-406d-8855-f62051b3c187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:53.969907 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e8193ecf-7073-406d-8855-f62051b3c187 None None] MFA Rules not processed for user `27d080633dfa4ac7b4159514034f3e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:53.971217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e8193ecf-7073-406d-8855-f62051b3c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:54.042317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1354/2730] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:54.054914 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77869c06-0c99-4a43-8afd-dd73051c3d69 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:54.057787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-77869c06-0c99-4a43-8afd-dd73051c3d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:54.117578 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77869c06-0c99-4a43-8afd-dd73051c3d69 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:54.121812 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c3dfc-68ab-4212-990c-03db3713152d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:54.122483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3dfc-68ab-4212-990c-03db3713152d service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:54.122763 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3dfc-68ab-4212-990c-03db3713152d service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:54.123036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3dfc-68ab-4212-990c-03db3713152d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:54.183528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c3dfc-68ab-4212-990c-03db3713152d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:54.184884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c3dfc-68ab-4212-990c-03db3713152d service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:54.194324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1377/2731] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:55.716106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8193ecf-7073-406d-8855-f62051b3c187 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:55.717653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e8193ecf-7073-406d-8855-f62051b3c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:55.730330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8193ecf-7073-406d-8855-f62051b3c187 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:55.734754 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3b552-9bc2-4e84-af9d-caaa1f7a9ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:55.735424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b552-9bc2-4e84-af9d-caaa1f7a9ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:55.735737 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b552-9bc2-4e84-af9d-caaa1f7a9ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:55.736138 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b552-9bc2-4e84-af9d-caaa1f7a9ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:55.796103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3b552-9bc2-4e84-af9d-caaa1f7a9ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:55.797464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3b552-9bc2-4e84-af9d-caaa1f7a9ed8 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:55.806874 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1355/2732] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:56.354150 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c3dfc-68ab-4212-990c-03db3713152d service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:56.367188 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c3dfc-68ab-4212-990c-03db3713152d service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:56.373044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2744658-294e-441b-8360-fd5f0f9510ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:56.373694 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2744658-294e-441b-8360-fd5f0f9510ba service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:56.373970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2744658-294e-441b-8360-fd5f0f9510ba service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:56.374378 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2744658-294e-441b-8360-fd5f0f9510ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:56.383882 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2744658-294e-441b-8360-fd5f0f9510ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:56.385348 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2744658-294e-441b-8360-fd5f0f9510ba service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:56.395173 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1378/2733] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:00.330104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3b552-9bc2-4e84-af9d-caaa1f7a9ed8 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:00.403176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3b552-9bc2-4e84-af9d-caaa1f7a9ed8 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:00.409096 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:00.410002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:00.410351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:00.410627 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] PATH_INFO: `/v3/users/8b293656c0d042dd861c6ede067a3b0d` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:00.411966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b293656c0d042dd861c6ede067a3b0d)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:00.413896 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:00.464975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b293656c0d042dd861c6ede067a3b0d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:00.478219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b293656c0d042dd861c6ede067a3b0d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:00.478986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b293656c0d042dd861c6ede067a3b0d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:00.488674 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b293656c0d042dd861c6ede067a3b0d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:00.489302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b293656c0d042dd861c6ede067a3b0d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:00.501244 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1356/2734] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:00:00 2022] DELETE /identity/v3/users/8b293656c0d042dd861c6ede067a3b0d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:00.505978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1fadf-a68d-46ea-8456-a03c70e3d2e7 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:00.506498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1fadf-a68d-46ea-8456-a03c70e3d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:00.506498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1fadf-a68d-46ea-8456-a03c70e3d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:00.523818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b4a1fadf-a68d-46ea-8456-a03c70e3d2e7 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:00.525019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b4a1fadf-a68d-46ea-8456-a03c70e3d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:00.591319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1379/2735] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:00.604124 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:00.605706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:00.668409 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf19457-f2e1-4781-bc78-b04ce3feb658 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:00.672437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847ef66-eebb-4091-98e4-3c1332ca453a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:00.673083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847ef66-eebb-4091-98e4-3c1332ca453a service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:00.673357 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847ef66-eebb-4091-98e4-3c1332ca453a service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:00.673627 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847ef66-eebb-4091-98e4-3c1332ca453a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:00.682576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847ef66-eebb-4091-98e4-3c1332ca453a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:00.684004 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847ef66-eebb-4091-98e4-3c1332ca453a service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:00.693136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1357/2736] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:00.967448 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1fadf-a68d-46ea-8456-a03c70e3d2e7 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:00.968957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b4a1fadf-a68d-46ea-8456-a03c70e3d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:00.980931 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1fadf-a68d-46ea-8456-a03c70e3d2e7 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:00.986352 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:00.987257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:00.987537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:00.987946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] PATH_INFO: `/v3/projects/135838cb91084613bbecfca922399b76` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:00.989014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=135838cb91084613bbecfca922399b76)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:00.991022 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:01.040432 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135838cb91084613bbecfca922399b76', 'request_id': 'req-43889a11-3828-4128-bb8a-c51f6aee0705'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.046844 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135838cb91084613bbecfca922399b76', 'request_id': 'req-43889a11-3828-4128-bb8a-c51f6aee0705'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.057012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135838cb91084613bbecfca922399b76', 'request_id': 'req-43889a11-3828-4128-bb8a-c51f6aee0705'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.067702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] The token cache is being invalidate because project 135838cb91084613bbecfca922399b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:00:01.067968 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.068657 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.070347 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1380/2737] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:00:00 2022] DELETE /identity/v3/projects/135838cb91084613bbecfca922399b76 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:00:01.074465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847ef66-eebb-4091-98e4-3c1332ca453a service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:01.084102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847ef66-eebb-4091-98e4-3c1332ca453a service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:01.142952 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:01.143837 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:01.144111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:01.144379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] PATH_INFO: `/v3/users/1527f8ab4dbe44da81fbd5528a543310` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:01.145583 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1527f8ab4dbe44da81fbd5528a543310)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:01.147538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:01.203464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1527f8ab4dbe44da81fbd5528a543310'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.215232 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1527f8ab4dbe44da81fbd5528a543310'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.216037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1527f8ab4dbe44da81fbd5528a543310'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.224799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1527f8ab4dbe44da81fbd5528a543310'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.225465 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1527f8ab4dbe44da81fbd5528a543310'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.237928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1358/2738] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:00:01 2022] DELETE /identity/v3/users/1527f8ab4dbe44da81fbd5528a543310 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:01.515148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:01.516901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:01.530319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889a11-3828-4128-bb8a-c51f6aee0705 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:01.590044 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:01.590932 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:01.591215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:01.591494 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] PATH_INFO: `/v3/projects/8dde48f85acb4e9786572e137e52ab4c` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:01.592802 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dde48f85acb4e9786572e137e52ab4c)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:01.594801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:01.644813 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dde48f85acb4e9786572e137e52ab4c', 'request_id': 'req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.651391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dde48f85acb4e9786572e137e52ab4c', 'request_id': 'req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.660137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dde48f85acb4e9786572e137e52ab4c', 'request_id': 'req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.671509 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] The token cache is being invalidate because project 8dde48f85acb4e9786572e137e52ab4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:00:01.671795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.672454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.674019 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1381/2739] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:00:01 2022] DELETE /identity/v3/projects/8dde48f85acb4e9786572e137e52ab4c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:01.678405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:01.679860 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:01.692651 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abae41-9e0b-4fe5-8338-213b31637720 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:01.754764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:01.755639 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:01.755901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:01.756195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] PATH_INFO: `/v3/users/27d080633dfa4ac7b4159514034f3e7d` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:01.757494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d080633dfa4ac7b4159514034f3e7d)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:01.759483 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:01.813615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d080633dfa4ac7b4159514034f3e7d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.824820 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d080633dfa4ac7b4159514034f3e7d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.825468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d080633dfa4ac7b4159514034f3e7d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.834501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d080633dfa4ac7b4159514034f3e7d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.835141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0b93545e-3781-4e8b-b2b4-d12e97544cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d080633dfa4ac7b4159514034f3e7d'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:01.847250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1359/2740] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:00:01 2022] DELETE /identity/v3/users/27d080633dfa4ac7b4159514034f3e7d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:02.128699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:02.129990 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:02.144817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd301-e93c-4ceb-9dff-cf1e836d5dab admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:02.203205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:02.204067 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.204338 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.204604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] PATH_INFO: `/v3/projects/c4da78e5758644eca12185506d4f2ecd` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.205822 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4da78e5758644eca12185506d4f2ecd)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:02.207778 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:02.254995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4da78e5758644eca12185506d4f2ecd', 'request_id': 'req-a82d6b00-8739-4d40-9489-84ed7f672d4a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:02.261481 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4da78e5758644eca12185506d4f2ecd', 'request_id': 'req-a82d6b00-8739-4d40-9489-84ed7f672d4a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:02.270985 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4da78e5758644eca12185506d4f2ecd', 'request_id': 'req-a82d6b00-8739-4d40-9489-84ed7f672d4a'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:02.281556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] The token cache is being invalidate because project c4da78e5758644eca12185506d4f2ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:00:02.281928 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:02.282612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a82d6b00-8739-4d40-9489-84ed7f672d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:02.284195 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1382/2741] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:00:02 2022] DELETE /identity/v3/projects/c4da78e5758644eca12185506d4f2ecd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:02.289452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a190ee0-282d-42ea-9826-51830e00556f None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.289740 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a190ee0-282d-42ea-9826-51830e00556f None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.290032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a190ee0-282d-42ea-9826-51830e00556f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.309013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-3a190ee0-282d-42ea-9826-51830e00556f None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:02.310260 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-3a190ee0-282d-42ea-9826-51830e00556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:02.378704 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1360/2742] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:02.386884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2661f30-fe66-4a8a-a213-fc2569b483e2 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.387193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2661f30-fe66-4a8a-a213-fc2569b483e2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.387470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2661f30-fe66-4a8a-a213-fc2569b483e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.407717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-c2661f30-fe66-4a8a-a213-fc2569b483e2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:02.408929 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c2661f30-fe66-4a8a-a213-fc2569b483e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:02.418675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1383/2743] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:00:02.422943 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a190ee0-282d-42ea-9826-51830e00556f None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:02.433834 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a190ee0-282d-42ea-9826-51830e00556f None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:02.439735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e95e4-68ce-49a3-8896-3819847fb71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:02.440398 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e95e4-68ce-49a3-8896-3819847fb71e admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.440682 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e95e4-68ce-49a3-8896-3819847fb71e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.440952 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e95e4-68ce-49a3-8896-3819847fb71e admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.441685 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e95e4-68ce-49a3-8896-3819847fb71e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:00:02.441989 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e95e4-68ce-49a3-8896-3819847fb71e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:02.443629 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e95e4-68ce-49a3-8896-3819847fb71e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:02.455543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1361/2744] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:00:02.460726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2661f30-fe66-4a8a-a213-fc2569b483e2 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:02.472877 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2661f30-fe66-4a8a-a213-fc2569b483e2 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:02.479192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d374-b7c4-47be-8677-28ab2259e7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:02.479843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d374-b7c4-47be-8677-28ab2259e7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.480124 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d374-b7c4-47be-8677-28ab2259e7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.480394 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d374-b7c4-47be-8677-28ab2259e7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.481080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5d374-b7c4-47be-8677-28ab2259e7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:02.483033 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5d374-b7c4-47be-8677-28ab2259e7b4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:02.511402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1384/2745] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:00:02 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:00:02.517097 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e95e4-68ce-49a3-8896-3819847fb71e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:02.527901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e95e4-68ce-49a3-8896-3819847fb71e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:02.588803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998847e-eff0-4ef8-bfde-079b580122af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:02.589464 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998847e-eff0-4ef8-bfde-079b580122af admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.589743 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998847e-eff0-4ef8-bfde-079b580122af admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.590015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998847e-eff0-4ef8-bfde-079b580122af admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.590723 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998847e-eff0-4ef8-bfde-079b580122af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:02.592916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998847e-eff0-4ef8-bfde-079b580122af admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:02.616448 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1362/2746] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:00:02 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:00:02.623272 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d374-b7c4-47be-8677-28ab2259e7b4 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:02.634028 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d374-b7c4-47be-8677-28ab2259e7b4 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:02.639082 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c1284-8bbf-49fd-8828-e521f0779296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:02.639922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c1284-8bbf-49fd-8828-e521f0779296 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.640219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c1284-8bbf-49fd-8828-e521f0779296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.640488 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c1284-8bbf-49fd-8828-e521f0779296 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.641223 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c1284-8bbf-49fd-8828-e521f0779296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:02.642987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c1284-8bbf-49fd-8828-e521f0779296 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:02.654119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1385/2747] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:00:02.658544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998847e-eff0-4ef8-bfde-079b580122af admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:02.669379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998847e-eff0-4ef8-bfde-079b580122af admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:02.674182 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a62a7-d0e8-4edf-b5c4-175eec4dea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:02.674835 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a62a7-d0e8-4edf-b5c4-175eec4dea6d admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.675113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a62a7-d0e8-4edf-b5c4-175eec4dea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.675379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a62a7-d0e8-4edf-b5c4-175eec4dea6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.676101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a62a7-d0e8-4edf-b5c4-175eec4dea6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:02.677706 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a62a7-d0e8-4edf-b5c4-175eec4dea6d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:02.687607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1363/2748] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:00:02.692050 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c1284-8bbf-49fd-8828-e521f0779296 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:02.702322 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c1284-8bbf-49fd-8828-e521f0779296 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:02.707107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81765788-0c05-4053-b74f-e5d46acf0df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:02.707998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765788-0c05-4053-b74f-e5d46acf0df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.708280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765788-0c05-4053-b74f-e5d46acf0df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.708556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765788-0c05-4053-b74f-e5d46acf0df7 admin admin] PATH_INFO: `/v3/projects/6c9bd96460804522a397af8d0ca875ed/users/83686d93c38c440ab5a882b7fecf9b53/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.722847 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81765788-0c05-4053-b74f-e5d46acf0df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9bd96460804522a397af8d0ca875ed, user_id=83686d93c38c440ab5a882b7fecf9b53, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:02.725489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81765788-0c05-4053-b74f-e5d46acf0df7 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:02.740468 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1386/2749] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:00:02 2022] PUT /identity/v3/projects/6c9bd96460804522a397af8d0ca875ed/users/83686d93c38c440ab5a882b7fecf9b53/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:02.757380 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fe1ac-34c4-43c0-9a74-5e3b0a6d481b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.757731 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fe1ac-34c4-43c0-9a74-5e3b0a6d481b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.758184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fe1ac-34c4-43c0-9a74-5e3b0a6d481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.790692 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-5d2fe1ac-34c4-43c0-9a74-5e3b0a6d481b None None] MFA Rules not processed for user `83686d93c38c440ab5a882b7fecf9b53`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:02.791933 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5d2fe1ac-34c4-43c0-9a74-5e3b0a6d481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:02.859605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1364/2750] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:02.871318 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81765788-0c05-4053-b74f-e5d46acf0df7 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:02.873365 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-81765788-0c05-4053-b74f-e5d46acf0df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:02.936699 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81765788-0c05-4053-b74f-e5d46acf0df7 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:02.941797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30c0dd-2a2a-49f7-b308-29b6aa2d137b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:02.942479 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c0dd-2a2a-49f7-b308-29b6aa2d137b service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:02.942758 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c0dd-2a2a-49f7-b308-29b6aa2d137b service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:02.943025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c0dd-2a2a-49f7-b308-29b6aa2d137b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:02.952470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30c0dd-2a2a-49f7-b308-29b6aa2d137b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:02.953924 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30c0dd-2a2a-49f7-b308-29b6aa2d137b service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:02.963196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1387/2751] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:05.544056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fe1ac-34c4-43c0-9a74-5e3b0a6d481b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:05.611095 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fe1ac-34c4-43c0-9a74-5e3b0a6d481b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:05.616285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:05.617169 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:05.617451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:05.617732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] PATH_INFO: `/v3/users/83686d93c38c440ab5a882b7fecf9b53` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:05.619061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83686d93c38c440ab5a882b7fecf9b53)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:05.621005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:05.674405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83686d93c38c440ab5a882b7fecf9b53'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:05.685907 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83686d93c38c440ab5a882b7fecf9b53'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:05.686619 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83686d93c38c440ab5a882b7fecf9b53'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:05.694685 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83686d93c38c440ab5a882b7fecf9b53'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:05.695304 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83686d93c38c440ab5a882b7fecf9b53'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:05.707221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1365/2752] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:00:05 2022] DELETE /identity/v3/users/83686d93c38c440ab5a882b7fecf9b53 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:05.712090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb81b5-5a8a-453f-8e13-14547bdc14c1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:05.712577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb81b5-5a8a-453f-8e13-14547bdc14c1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:05.712702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb81b5-5a8a-453f-8e13-14547bdc14c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:05.730616 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-34eb81b5-5a8a-453f-8e13-14547bdc14c1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:05.731828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-34eb81b5-5a8a-453f-8e13-14547bdc14c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:05.794879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1388/2753] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:05.804775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:05.806384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:05.869741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c31817-0cc1-4ecb-983b-56be9d547598 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:05.873607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaebb9-38cb-420c-832e-4d4b8361e294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:05.874284 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaebb9-38cb-420c-832e-4d4b8361e294 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:05.874583 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaebb9-38cb-420c-832e-4d4b8361e294 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:05.874859 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaebb9-38cb-420c-832e-4d4b8361e294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:05.883787 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaebb9-38cb-420c-832e-4d4b8361e294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:05.885258 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaebb9-38cb-420c-832e-4d4b8361e294 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:05.894676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1366/2754] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:06.161095 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb81b5-5a8a-453f-8e13-14547bdc14c1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:06.162740 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-34eb81b5-5a8a-453f-8e13-14547bdc14c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:06.176007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb81b5-5a8a-453f-8e13-14547bdc14c1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:06.181027 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:06.181927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.182187 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.182493 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] PATH_INFO: `/v3/projects/6c9bd96460804522a397af8d0ca875ed` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.183738 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9bd96460804522a397af8d0ca875ed)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:06.185773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:06.235051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9bd96460804522a397af8d0ca875ed', 'request_id': 'req-22c90c2a-639e-4b10-9577-889c53f27a57'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:06.241604 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9bd96460804522a397af8d0ca875ed', 'request_id': 'req-22c90c2a-639e-4b10-9577-889c53f27a57'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:06.251206 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9bd96460804522a397af8d0ca875ed', 'request_id': 'req-22c90c2a-639e-4b10-9577-889c53f27a57'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:06.261800 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] The token cache is being invalidate because project 6c9bd96460804522a397af8d0ca875ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:00:06.262106 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:06.262829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-22c90c2a-639e-4b10-9577-889c53f27a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:06.264471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1389/2755] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:00:06 2022] DELETE /identity/v3/projects/6c9bd96460804522a397af8d0ca875ed => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:06.269600 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbae53-e7cb-4d4b-9e48-773e943eddf8 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.269883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbae53-e7cb-4d4b-9e48-773e943eddf8 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.270475 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbae53-e7cb-4d4b-9e48-773e943eddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.289387 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-06dbae53-e7cb-4d4b-9e48-773e943eddf8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:06.290650 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-06dbae53-e7cb-4d4b-9e48-773e943eddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:06.357693 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1367/2756] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:00:06.366846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f90904-18a5-4bf3-924a-7241efff29ab None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.367128 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f90904-18a5-4bf3-924a-7241efff29ab None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.367395 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f90904-18a5-4bf3-924a-7241efff29ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.387165 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-e8f90904-18a5-4bf3-924a-7241efff29ab None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:06.388369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-e8f90904-18a5-4bf3-924a-7241efff29ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:06.398046 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1390/2757] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:06.402500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbae53-e7cb-4d4b-9e48-773e943eddf8 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:06.412190 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbae53-e7cb-4d4b-9e48-773e943eddf8 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:06.416846 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78e9e3-97db-437c-955e-b7fb3f17d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:06.417520 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78e9e3-97db-437c-955e-b7fb3f17d3ea admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.417813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78e9e3-97db-437c-955e-b7fb3f17d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.418479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78e9e3-97db-437c-955e-b7fb3f17d3ea admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.419207 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78e9e3-97db-437c-955e-b7fb3f17d3ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:00:06.419511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78e9e3-97db-437c-955e-b7fb3f17d3ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:06.421115 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78e9e3-97db-437c-955e-b7fb3f17d3ea admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:06.432760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1368/2758] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:00:06.438633 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f90904-18a5-4bf3-924a-7241efff29ab None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:06.451828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f90904-18a5-4bf3-924a-7241efff29ab None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:06.459183 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ee929-1775-4160-a7ac-8c4751debd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:06.459830 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ee929-1775-4160-a7ac-8c4751debd33 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.460103 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ee929-1775-4160-a7ac-8c4751debd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.460334 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ee929-1775-4160-a7ac-8c4751debd33 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.461013 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ee929-1775-4160-a7ac-8c4751debd33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:06.462943 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ee929-1775-4160-a7ac-8c4751debd33 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:06.491631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1391/2759] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:00:06 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:00:06.495799 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78e9e3-97db-437c-955e-b7fb3f17d3ea admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:06.506165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78e9e3-97db-437c-955e-b7fb3f17d3ea admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:06.564576 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6725b6-19e2-476b-af71-c924040b0dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:06.565265 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6725b6-19e2-476b-af71-c924040b0dea admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.565557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6725b6-19e2-476b-af71-c924040b0dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.565833 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6725b6-19e2-476b-af71-c924040b0dea admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.566573 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6725b6-19e2-476b-af71-c924040b0dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:06.568529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6725b6-19e2-476b-af71-c924040b0dea admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:06.589811 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1369/2760] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:00:06 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:00:06.594068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ee929-1775-4160-a7ac-8c4751debd33 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:06.604415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ee929-1775-4160-a7ac-8c4751debd33 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:06.610635 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d305d-a3a0-4b74-b6bf-4b3169256739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:06.611271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d305d-a3a0-4b74-b6bf-4b3169256739 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.611545 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d305d-a3a0-4b74-b6bf-4b3169256739 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.611813 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d305d-a3a0-4b74-b6bf-4b3169256739 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.612801 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d305d-a3a0-4b74-b6bf-4b3169256739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:06.614612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d305d-a3a0-4b74-b6bf-4b3169256739 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:06.625885 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1392/2761] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:00:06.630359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6725b6-19e2-476b-af71-c924040b0dea admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:06.640738 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6725b6-19e2-476b-af71-c924040b0dea admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:06.646643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e941094-c491-4f26-aaab-08c04c391868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:06.647316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941094-c491-4f26-aaab-08c04c391868 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.647596 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941094-c491-4f26-aaab-08c04c391868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.647866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941094-c491-4f26-aaab-08c04c391868 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.648595 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e941094-c491-4f26-aaab-08c04c391868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:06.650227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e941094-c491-4f26-aaab-08c04c391868 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:06.661185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1370/2762] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:00:06.665648 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d305d-a3a0-4b74-b6bf-4b3169256739 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:06.676483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d305d-a3a0-4b74-b6bf-4b3169256739 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:06.681638 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63092869-0061-4494-a9f0-19c7a590db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:06.682550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63092869-0061-4494-a9f0-19c7a590db32 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.682829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63092869-0061-4494-a9f0-19c7a590db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.683101 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63092869-0061-4494-a9f0-19c7a590db32 admin admin] PATH_INFO: `/v3/projects/47b14417516d4819861d406bb3d6716e/users/dbccd20981124fe4ae977449bba3fb6e/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.698607 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63092869-0061-4494-a9f0-19c7a590db32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b14417516d4819861d406bb3d6716e, user_id=dbccd20981124fe4ae977449bba3fb6e, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:06.701353 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63092869-0061-4494-a9f0-19c7a590db32 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:06.716957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1393/2763] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:00:06 2022] PUT /identity/v3/projects/47b14417516d4819861d406bb3d6716e/users/dbccd20981124fe4ae977449bba3fb6e/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:06.785147 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14ea7-0c69-4e5c-b05a-c76fc2ab66b0 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.785495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14ea7-0c69-4e5c-b05a-c76fc2ab66b0 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.786005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14ea7-0c69-4e5c-b05a-c76fc2ab66b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.822704 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-0de14ea7-0c69-4e5c-b05a-c76fc2ab66b0 None None] MFA Rules not processed for user `dbccd20981124fe4ae977449bba3fb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:06.823918 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0de14ea7-0c69-4e5c-b05a-c76fc2ab66b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:06.892326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1371/2764] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:06.905539 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63092869-0061-4494-a9f0-19c7a590db32 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:06.907527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-63092869-0061-4494-a9f0-19c7a590db32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:06.963467 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63092869-0061-4494-a9f0-19c7a590db32 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:06.967967 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abf461-5577-4781-8d86-0b324c6c8acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:06.968602 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abf461-5577-4781-8d86-0b324c6c8acd service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:06.968879 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abf461-5577-4781-8d86-0b324c6c8acd service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:06.969125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abf461-5577-4781-8d86-0b324c6c8acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:06.977774 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abf461-5577-4781-8d86-0b324c6c8acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:06.979253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abf461-5577-4781-8d86-0b324c6c8acd service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:06.988094 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1394/2765] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:23.393005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14ea7-0c69-4e5c-b05a-c76fc2ab66b0 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:23.461935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14ea7-0c69-4e5c-b05a-c76fc2ab66b0 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:23.467213 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:23.468077 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:23.468353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:23.468625 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] PATH_INFO: `/v3/users/dbccd20981124fe4ae977449bba3fb6e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:23.469917 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbccd20981124fe4ae977449bba3fb6e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:23.471954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:23.530363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbccd20981124fe4ae977449bba3fb6e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:23.542199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbccd20981124fe4ae977449bba3fb6e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:23.542862 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbccd20981124fe4ae977449bba3fb6e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:23.552752 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbccd20981124fe4ae977449bba3fb6e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:23.553424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbccd20981124fe4ae977449bba3fb6e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:23.566542 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1372/2766] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:00:23 2022] DELETE /identity/v3/users/dbccd20981124fe4ae977449bba3fb6e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:23.571225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54566bb8-7b42-4680-b0ca-45d0ecf1a304 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:23.571690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54566bb8-7b42-4680-b0ca-45d0ecf1a304 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:23.571803 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54566bb8-7b42-4680-b0ca-45d0ecf1a304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:23.589426 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-54566bb8-7b42-4680-b0ca-45d0ecf1a304 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:23.590672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-54566bb8-7b42-4680-b0ca-45d0ecf1a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:23.654511 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1395/2767] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:23.665019 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:23.666643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:23.728352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639376b-f0e3-4984-9dc6-0c246290418a admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:23.732417 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74470-d47c-462a-beaa-9635e683af68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:23.733060 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74470-d47c-462a-beaa-9635e683af68 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:23.733348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74470-d47c-462a-beaa-9635e683af68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:23.733617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74470-d47c-462a-beaa-9635e683af68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:23.742958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c74470-d47c-462a-beaa-9635e683af68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:23.744500 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c74470-d47c-462a-beaa-9635e683af68 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:23.753956 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1373/2768] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:24.032358 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54566bb8-7b42-4680-b0ca-45d0ecf1a304 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:24.033811 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-54566bb8-7b42-4680-b0ca-45d0ecf1a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:24.047444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54566bb8-7b42-4680-b0ca-45d0ecf1a304 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:24.053140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:24.054032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:24.054333 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:24.054600 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] PATH_INFO: `/v3/projects/47b14417516d4819861d406bb3d6716e` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:24.056023 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b14417516d4819861d406bb3d6716e)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:24.057948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:24.107062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b14417516d4819861d406bb3d6716e', 'request_id': 'req-3f459b4e-9711-402b-b398-171fcd9cd348'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:24.113134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b14417516d4819861d406bb3d6716e', 'request_id': 'req-3f459b4e-9711-402b-b398-171fcd9cd348'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:24.121281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b14417516d4819861d406bb3d6716e', 'request_id': 'req-3f459b4e-9711-402b-b398-171fcd9cd348'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:24.131249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] The token cache is being invalidate because project 47b14417516d4819861d406bb3d6716e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:00:24.131531 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:24.132160 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-3f459b4e-9711-402b-b398-171fcd9cd348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:24.133698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1396/2769] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:00:24 2022] DELETE /identity/v3/projects/47b14417516d4819861d406bb3d6716e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:00:29.334794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74470-d47c-462a-beaa-9635e683af68 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:29.336478 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c8c74470-d47c-462a-beaa-9635e683af68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:29.406415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74470-d47c-462a-beaa-9635e683af68 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:29.465496 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642917d1-b518-4e69-a8d9-bbaf7285e734 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:29.466178 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642917d1-b518-4e69-a8d9-bbaf7285e734 service placement] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:29.466463 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642917d1-b518-4e69-a8d9-bbaf7285e734 service placement] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:29.466733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642917d1-b518-4e69-a8d9-bbaf7285e734 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:29.468565 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-642917d1-b518-4e69-a8d9-bbaf7285e734 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:29.480059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642917d1-b518-4e69-a8d9-bbaf7285e734 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:29.481775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642917d1-b518-4e69-a8d9-bbaf7285e734 service placement] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:29.503528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1374/2770] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:39.708502 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5467e6-45a7-407f-8909-0bb3d57a6a86 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:39.709012 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5467e6-45a7-407f-8909-0bb3d57a6a86 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:39.709230 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5467e6-45a7-407f-8909-0bb3d57a6a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:39.727674 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-cd5467e6-45a7-407f-8909-0bb3d57a6a86 None None] MFA Rules not processed for user `8b88c647679b404d9d9ae17890ef10fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:39.728903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-cd5467e6-45a7-407f-8909-0bb3d57a6a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:39.793558 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1397/2771] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:41.039011 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036442b-8db7-4776-b7d4-24d6fbba5144 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:41.039524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036442b-8db7-4776-b7d4-24d6fbba5144 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:41.039524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036442b-8db7-4776-b7d4-24d6fbba5144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:41.057555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-8036442b-8db7-4776-b7d4-24d6fbba5144 None None] MFA Rules not processed for user `cc688d3f2f7f4230a5715b5ba437ea59`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:41.058782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8036442b-8db7-4776-b7d4-24d6fbba5144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:41.118842 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1375/2772] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:48.887697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5467e6-45a7-407f-8909-0bb3d57a6a86 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:48.889093 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-cd5467e6-45a7-407f-8909-0bb3d57a6a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:48.947834 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5467e6-45a7-407f-8909-0bb3d57a6a86 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:48.951346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8706c-5ee4-45f8-a9fd-ccb37a1df4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:48.951999 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8706c-5ee4-45f8-a9fd-ccb37a1df4eb service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:48.952277 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8706c-5ee4-45f8-a9fd-ccb37a1df4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:48.952549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8706c-5ee4-45f8-a9fd-ccb37a1df4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:48.954470 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0fc8706c-5ee4-45f8-a9fd-ccb37a1df4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:48.965237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8706c-5ee4-45f8-a9fd-ccb37a1df4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:48.966710 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8706c-5ee4-45f8-a9fd-ccb37a1df4eb service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:48.977213 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1398/2773] 10.222.0.20 () {60 vars in 1396 bytes} [Fri Oct 28 20:00:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:01:37.625070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7f8ad-5fb9-4cb4-8dca-a15ae1aad03d None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:37.625638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7f8ad-5fb9-4cb4-8dca-a15ae1aad03d None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:37.625638 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7f8ad-5fb9-4cb4-8dca-a15ae1aad03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:37.644024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-c1c7f8ad-5fb9-4cb4-8dca-a15ae1aad03d None None] MFA Rules not processed for user `8b88c647679b404d9d9ae17890ef10fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:37.645243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-c1c7f8ad-5fb9-4cb4-8dca-a15ae1aad03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:37.652832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1376/2774] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:01:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:29.056584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8706c-5ee4-45f8-a9fd-ccb37a1df4eb service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:29.058132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-0fc8706c-5ee4-45f8-a9fd-ccb37a1df4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:29.117771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8706c-5ee4-45f8-a9fd-ccb37a1df4eb service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:29.121884 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef0ab-5268-425f-9eb2-e9f3f62dd7fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:29.122576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef0ab-5268-425f-9eb2-e9f3f62dd7fc service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:29.122859 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef0ab-5268-425f-9eb2-e9f3f62dd7fc service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:29.123134 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef0ab-5268-425f-9eb2-e9f3f62dd7fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:29.124950 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-122ef0ab-5268-425f-9eb2-e9f3f62dd7fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:29.196733 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef0ab-5268-425f-9eb2-e9f3f62dd7fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:29.198112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef0ab-5268-425f-9eb2-e9f3f62dd7fc service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:29.209110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1399/2775] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:35.857421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7f8ad-5fb9-4cb4-8dca-a15ae1aad03d None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:35.867041 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7f8ad-5fb9-4cb4-8dca-a15ae1aad03d None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:35.871126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6306-4c90-46c5-aadf-12a1ef9ab0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:35.871905 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6306-4c90-46c5-aadf-12a1ef9ab0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:35.872189 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6306-4c90-46c5-aadf-12a1ef9ab0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:35.872561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6306-4c90-46c5-aadf-12a1ef9ab0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:35.875137 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-663e6306-4c90-46c5-aadf-12a1ef9ab0d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:35.889712 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e6306-4c90-46c5-aadf-12a1ef9ab0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:35.891813 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e6306-4c90-46c5-aadf-12a1ef9ab0d6 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:35.903069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1377/2776] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:43.210895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34d882-00e9-492a-842b-1c54be9379c9 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:43.211437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34d882-00e9-492a-842b-1c54be9379c9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:43.211437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34d882-00e9-492a-842b-1c54be9379c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:43.228894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6d34d882-00e9-492a-842b-1c54be9379c9 None None] MFA Rules not processed for user `8b88c647679b404d9d9ae17890ef10fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:43.230112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6d34d882-00e9-492a-842b-1c54be9379c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:43.237154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1400/2777] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:02:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:43.745966 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6306-4c90-46c5-aadf-12a1ef9ab0d6 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:43.747782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-663e6306-4c90-46c5-aadf-12a1ef9ab0d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:43.761845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6306-4c90-46c5-aadf-12a1ef9ab0d6 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:43.765920 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adba550-732d-4e5e-a4c4-5729e7145a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:43.766633 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba550-732d-4e5e-a4c4-5729e7145a09 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:43.767090 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba550-732d-4e5e-a4c4-5729e7145a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:43.767342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba550-732d-4e5e-a4c4-5729e7145a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:43.769430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7adba550-732d-4e5e-a4c4-5729e7145a09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:43.779974 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba550-732d-4e5e-a4c4-5729e7145a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:43.781655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba550-732d-4e5e-a4c4-5729e7145a09 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:43.796580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1378/2778] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:49.507677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34d882-00e9-492a-842b-1c54be9379c9 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:49.517750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34d882-00e9-492a-842b-1c54be9379c9 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:49.521457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661d019-b00b-4cb9-81d9-3c1c04fc8260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:49.522119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661d019-b00b-4cb9-81d9-3c1c04fc8260 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:49.522402 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661d019-b00b-4cb9-81d9-3c1c04fc8260 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:49.522670 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661d019-b00b-4cb9-81d9-3c1c04fc8260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:49.524430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c661d019-b00b-4cb9-81d9-3c1c04fc8260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:49.586922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661d019-b00b-4cb9-81d9-3c1c04fc8260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:49.588367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661d019-b00b-4cb9-81d9-3c1c04fc8260 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:49.598890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1401/2779] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:55.983446 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adba550-732d-4e5e-a4c4-5729e7145a09 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:55.992143 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adba550-732d-4e5e-a4c4-5729e7145a09 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:55.995908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb888ed-4fe0-4c85-873e-02ed87bc4c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:55.996676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb888ed-4fe0-4c85-873e-02ed87bc4c11 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:55.997023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb888ed-4fe0-4c85-873e-02ed87bc4c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:55.997486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb888ed-4fe0-4c85-873e-02ed87bc4c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:55.999375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7cb888ed-4fe0-4c85-873e-02ed87bc4c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:56.011803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb888ed-4fe0-4c85-873e-02ed87bc4c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:56.014287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb888ed-4fe0-4c85-873e-02ed87bc4c11 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:56.025383 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1379/2780] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:02:56.759337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661d019-b00b-4cb9-81d9-3c1c04fc8260 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:56.760751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c661d019-b00b-4cb9-81d9-3c1c04fc8260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:56.772540 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661d019-b00b-4cb9-81d9-3c1c04fc8260 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:56.777302 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:56.778222 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:56.778616 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:56.778898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] PATH_INFO: `/v3/users/cc688d3f2f7f4230a5715b5ba437ea59` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:56.780226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc688d3f2f7f4230a5715b5ba437ea59)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:56.782199 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:56.828114 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc688d3f2f7f4230a5715b5ba437ea59'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:56.839430 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc688d3f2f7f4230a5715b5ba437ea59'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:56.840121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc688d3f2f7f4230a5715b5ba437ea59'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:56.840762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc688d3f2f7f4230a5715b5ba437ea59'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:56.850480 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc688d3f2f7f4230a5715b5ba437ea59'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:56.862473 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1402/2781] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:02:56 2022] DELETE /identity/v3/users/cc688d3f2f7f4230a5715b5ba437ea59 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:57.039313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb888ed-4fe0-4c85-873e-02ed87bc4c11 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:57.052337 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb888ed-4fe0-4c85-873e-02ed87bc4c11 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:57.108808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:57.109673 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:57.109946 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:57.110248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] PATH_INFO: `/v3/projects/42ce8f3da9ea4ee9a28652bd99014bc0` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:57.111436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ce8f3da9ea4ee9a28652bd99014bc0)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:57.113334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:57.160126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ce8f3da9ea4ee9a28652bd99014bc0', 'request_id': 'req-719fa1ae-d00b-46be-b858-36ab47b56254'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.166104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ce8f3da9ea4ee9a28652bd99014bc0', 'request_id': 'req-719fa1ae-d00b-46be-b858-36ab47b56254'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.175525 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ce8f3da9ea4ee9a28652bd99014bc0', 'request_id': 'req-719fa1ae-d00b-46be-b858-36ab47b56254'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.187972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] The token cache is being invalidate because project 42ce8f3da9ea4ee9a28652bd99014bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:02:57.188286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.189192 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.191491 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1380/2782] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:02:57 2022] DELETE /identity/v3/projects/42ce8f3da9ea4ee9a28652bd99014bc0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:02:57.195825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:57.197303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:57.210514 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0b0d-5563-4838-9e74-e77ef2ba1326 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:57.269180 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:57.270056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:57.270369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:57.270641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] PATH_INFO: `/v3/users/117cd5f9da40458f8a6f1cc2d9356562` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:57.271920 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=117cd5f9da40458f8a6f1cc2d9356562)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:57.273848 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:57.321601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '117cd5f9da40458f8a6f1cc2d9356562'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.333218 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '117cd5f9da40458f8a6f1cc2d9356562'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.333888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '117cd5f9da40458f8a6f1cc2d9356562'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.334537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '117cd5f9da40458f8a6f1cc2d9356562'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.343315 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '117cd5f9da40458f8a6f1cc2d9356562'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.355443 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1403/2783] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:02:57 2022] DELETE /identity/v3/users/117cd5f9da40458f8a6f1cc2d9356562 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:57.529366 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:57.530958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:57.545855 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fa1ae-d00b-46be-b858-36ab47b56254 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:57.605630 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:57.606451 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:57.606730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:57.607002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] PATH_INFO: `/v3/projects/022f27384de949da85cb2b4b8c35c0dc` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:57.608248 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=022f27384de949da85cb2b4b8c35c0dc)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:57.610215 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:57.656470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022f27384de949da85cb2b4b8c35c0dc', 'request_id': 'req-eca31baf-d5e0-4eb6-92e2-cfd696917870'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.662858 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022f27384de949da85cb2b4b8c35c0dc', 'request_id': 'req-eca31baf-d5e0-4eb6-92e2-cfd696917870'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.671635 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022f27384de949da85cb2b4b8c35c0dc', 'request_id': 'req-eca31baf-d5e0-4eb6-92e2-cfd696917870'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.682629 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] The token cache is being invalidate because project 022f27384de949da85cb2b4b8c35c0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:02:57.682908 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.683526 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.685135 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1381/2784] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:02:57 2022] DELETE /identity/v3/projects/022f27384de949da85cb2b4b8c35c0dc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:45.000598 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:45.002732 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:45.015713 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3a1b4-9acd-4d1b-9e5a-7ec0974da35a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:45.070549 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:45.071466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.071749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.072024 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] PATH_INFO: `/v3/users/8b88c647679b404d9d9ae17890ef10fe` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.073259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b88c647679b404d9d9ae17890ef10fe)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:45.075260 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:45.123538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b88c647679b404d9d9ae17890ef10fe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:45.134411 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b88c647679b404d9d9ae17890ef10fe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:45.135051 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b88c647679b404d9d9ae17890ef10fe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:45.135660 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b88c647679b404d9d9ae17890ef10fe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:45.143132 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cca942cb-ae94-4859-861c-6c05344a4087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b88c647679b404d9d9ae17890ef10fe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:45.154737 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1404/2785] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:44 2022] DELETE /identity/v3/users/8b88c647679b404d9d9ae17890ef10fe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:45.331764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:45.333384 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:45.346614 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca31baf-d5e0-4eb6-92e2-cfd696917870 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:45.404254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:45.405118 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.405402 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.405659 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] PATH_INFO: `/v3/projects/85f6535669e54d06b11a6a4c37f07cb4` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.406898 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f6535669e54d06b11a6a4c37f07cb4)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:45.408824 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:45.457023 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f6535669e54d06b11a6a4c37f07cb4', 'request_id': 'req-60f6a87f-5cbb-412b-915e-db8fdaff06f9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:45.463083 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f6535669e54d06b11a6a4c37f07cb4', 'request_id': 'req-60f6a87f-5cbb-412b-915e-db8fdaff06f9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:45.472552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f6535669e54d06b11a6a4c37f07cb4', 'request_id': 'req-60f6a87f-5cbb-412b-915e-db8fdaff06f9'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:45.483021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] The token cache is being invalidate because project 85f6535669e54d06b11a6a4c37f07cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:45.483312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:45.483986 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-60f6a87f-5cbb-412b-915e-db8fdaff06f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:45.485670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1382/2786] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:45 2022] DELETE /identity/v3/projects/85f6535669e54d06b11a6a4c37f07cb4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:45.492965 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a376cd-19d9-4fd5-9b65-3fdb3eadfaa2 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.493275 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a376cd-19d9-4fd5-9b65-3fdb3eadfaa2 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.493554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a376cd-19d9-4fd5-9b65-3fdb3eadfaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.513186 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-c2a376cd-19d9-4fd5-9b65-3fdb3eadfaa2 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:45.514332 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c2a376cd-19d9-4fd5-9b65-3fdb3eadfaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:45.585319 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1405/2787] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:45.594515 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a2a8-0db9-433d-9163-09192858520c None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.594800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a2a8-0db9-433d-9163-09192858520c None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.595104 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a2a8-0db9-433d-9163-09192858520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.613715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-7d66a2a8-0db9-433d-9163-09192858520c None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:45.614935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-7d66a2a8-0db9-433d-9163-09192858520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:45.623424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1383/2788] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:45.627994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a376cd-19d9-4fd5-9b65-3fdb3eadfaa2 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:45.637702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a376cd-19d9-4fd5-9b65-3fdb3eadfaa2 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:45.643252 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b77839-04f0-4035-ae85-970661647c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:45.644371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b77839-04f0-4035-ae85-970661647c23 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.644371 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b77839-04f0-4035-ae85-970661647c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.644582 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b77839-04f0-4035-ae85-970661647c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.645148 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b77839-04f0-4035-ae85-970661647c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:03:45.645438 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b77839-04f0-4035-ae85-970661647c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:45.647079 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b77839-04f0-4035-ae85-970661647c23 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:45.659461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1406/2789] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:03:45.664056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a2a8-0db9-433d-9163-09192858520c None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:45.673705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a2a8-0db9-433d-9163-09192858520c None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:45.679276 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb89e26-8780-4efd-8a45-ca79912576be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:45.679937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb89e26-8780-4efd-8a45-ca79912576be admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.680227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb89e26-8780-4efd-8a45-ca79912576be admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.680531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb89e26-8780-4efd-8a45-ca79912576be admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.681224 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb89e26-8780-4efd-8a45-ca79912576be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:45.683200 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb89e26-8780-4efd-8a45-ca79912576be admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:45.712219 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1384/2790] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:45 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:45.716425 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b77839-04f0-4035-ae85-970661647c23 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:45.727020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b77839-04f0-4035-ae85-970661647c23 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:45.789234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bfd92-089d-4940-af29-147c1b23328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:45.789926 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bfd92-089d-4940-af29-147c1b23328c admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.790245 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bfd92-089d-4940-af29-147c1b23328c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.790538 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bfd92-089d-4940-af29-147c1b23328c admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.791237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bfd92-089d-4940-af29-147c1b23328c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:45.793324 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bfd92-089d-4940-af29-147c1b23328c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:45.817398 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1407/2791] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:45 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:45.821760 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb89e26-8780-4efd-8a45-ca79912576be admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:45.832976 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb89e26-8780-4efd-8a45-ca79912576be admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:45.837791 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b676781-75f1-4dc0-a9ac-ac273445df82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:45.838497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b676781-75f1-4dc0-a9ac-ac273445df82 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.838775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b676781-75f1-4dc0-a9ac-ac273445df82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.839043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b676781-75f1-4dc0-a9ac-ac273445df82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.839771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b676781-75f1-4dc0-a9ac-ac273445df82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:45.841472 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b676781-75f1-4dc0-a9ac-ac273445df82 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:45.852121 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1385/2792] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:45.856250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bfd92-089d-4940-af29-147c1b23328c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:45.866462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bfd92-089d-4940-af29-147c1b23328c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:45.871441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c02642-36c2-4277-addc-6940944687e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:45.872107 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c02642-36c2-4277-addc-6940944687e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.872388 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c02642-36c2-4277-addc-6940944687e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.872664 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c02642-36c2-4277-addc-6940944687e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.873420 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c02642-36c2-4277-addc-6940944687e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:45.875081 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c02642-36c2-4277-addc-6940944687e4 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:45.885431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1408/2793] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:45.890070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b676781-75f1-4dc0-a9ac-ac273445df82 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:45.900378 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b676781-75f1-4dc0-a9ac-ac273445df82 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:45.905519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a07fbe-ff74-4e63-a223-6e40ed90d373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:45.906468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a07fbe-ff74-4e63-a223-6e40ed90d373 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.906744 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a07fbe-ff74-4e63-a223-6e40ed90d373 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.907015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a07fbe-ff74-4e63-a223-6e40ed90d373 admin admin] PATH_INFO: `/v3/projects/15658c6404bc4e6e964d40872e7d26c3/users/42cf67c7d4334bd2b9737c5730b9dcb0/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.921552 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a07fbe-ff74-4e63-a223-6e40ed90d373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15658c6404bc4e6e964d40872e7d26c3, user_id=42cf67c7d4334bd2b9737c5730b9dcb0, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:45.924815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a07fbe-ff74-4e63-a223-6e40ed90d373 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:45.939274 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1386/2794] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:45 2022] PUT /identity/v3/projects/15658c6404bc4e6e964d40872e7d26c3/users/42cf67c7d4334bd2b9737c5730b9dcb0/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:45.949866 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675e69-2734-48fc-9a9d-c6ddb4365997 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:45.950179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675e69-2734-48fc-9a9d-c6ddb4365997 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:45.950472 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675e69-2734-48fc-9a9d-c6ddb4365997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:45.977513 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-9c675e69-2734-48fc-9a9d-c6ddb4365997 None None] MFA Rules not processed for user `42cf67c7d4334bd2b9737c5730b9dcb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:45.978754 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9c675e69-2734-48fc-9a9d-c6ddb4365997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:46.041921 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1409/2795] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:46.053953 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a07fbe-ff74-4e63-a223-6e40ed90d373 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:46.055836 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e0a07fbe-ff74-4e63-a223-6e40ed90d373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:46.131282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a07fbe-ff74-4e63-a223-6e40ed90d373 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:46.137661 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64554a55-d6fb-4ab4-ac74-d176c77f7354 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:46.138336 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554a55-d6fb-4ab4-ac74-d176c77f7354 service nova] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:46.138609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554a55-d6fb-4ab4-ac74-d176c77f7354 service nova] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:46.138902 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554a55-d6fb-4ab4-ac74-d176c77f7354 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:46.148316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64554a55-d6fb-4ab4-ac74-d176c77f7354 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:46.150783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64554a55-d6fb-4ab4-ac74-d176c77f7354 service nova] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:46.164132 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1387/2796] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:53.475521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c675e69-2734-48fc-9a9d-c6ddb4365997 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:53.541281 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c675e69-2734-48fc-9a9d-c6ddb4365997 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:53.549764 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:53.551032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:53.551337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:53.551650 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] PATH_INFO: `/v3/users/42cf67c7d4334bd2b9737c5730b9dcb0` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:53.553620 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42cf67c7d4334bd2b9737c5730b9dcb0)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:53.556628 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:53.609064 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42cf67c7d4334bd2b9737c5730b9dcb0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:53.620479 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42cf67c7d4334bd2b9737c5730b9dcb0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:53.621212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42cf67c7d4334bd2b9737c5730b9dcb0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:53.621912 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42cf67c7d4334bd2b9737c5730b9dcb0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:53.632002 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42cf67c7d4334bd2b9737c5730b9dcb0'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:53.647707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1410/2797] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:53 2022] DELETE /identity/v3/users/42cf67c7d4334bd2b9737c5730b9dcb0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:53.652551 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb606f-4f72-4263-90c0-d0116d9cd952 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:53.653033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb606f-4f72-4263-90c0-d0116d9cd952 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:53.653152 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb606f-4f72-4263-90c0-d0116d9cd952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:53.671788 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d5cb606f-4f72-4263-90c0-d0116d9cd952 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:53.672994 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d5cb606f-4f72-4263-90c0-d0116d9cd952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:53.731431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1388/2798] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:53.743092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:53.744612 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:53.806317 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4c70f-13e3-4518-81cf-6267fe3c206a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:53.811870 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0984e8-8001-48a0-bfe0-a2351b1ad6a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:53.812528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0984e8-8001-48a0-bfe0-a2351b1ad6a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:53.812952 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0984e8-8001-48a0-bfe0-a2351b1ad6a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:53.813212 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0984e8-8001-48a0-bfe0-a2351b1ad6a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:53.825218 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0984e8-8001-48a0-bfe0-a2351b1ad6a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:53.826702 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0984e8-8001-48a0-bfe0-a2351b1ad6a1 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:53.835808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1411/2799] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:54.111605 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb606f-4f72-4263-90c0-d0116d9cd952 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.113106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d5cb606f-4f72-4263-90c0-d0116d9cd952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:54.125783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb606f-4f72-4263-90c0-d0116d9cd952 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.130575 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.131429 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.131710 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.131949 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] PATH_INFO: `/v3/projects/15658c6404bc4e6e964d40872e7d26c3` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.133410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15658c6404bc4e6e964d40872e7d26c3)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.135341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.184830 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15658c6404bc4e6e964d40872e7d26c3', 'request_id': 'req-992bc077-7510-40e8-b3ce-dc7645f23584'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:54.190892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15658c6404bc4e6e964d40872e7d26c3', 'request_id': 'req-992bc077-7510-40e8-b3ce-dc7645f23584'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:54.200588 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15658c6404bc4e6e964d40872e7d26c3', 'request_id': 'req-992bc077-7510-40e8-b3ce-dc7645f23584'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:54.210758 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] The token cache is being invalidate because project 15658c6404bc4e6e964d40872e7d26c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:54.211034 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:54.211631 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-992bc077-7510-40e8-b3ce-dc7645f23584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:54.213137 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1389/2800] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:54 2022] DELETE /identity/v3/projects/15658c6404bc4e6e964d40872e7d26c3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:54.219867 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5994ea-968b-4f63-9feb-c577d20fe1d1 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.220184 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5994ea-968b-4f63-9feb-c577d20fe1d1 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.220464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5994ea-968b-4f63-9feb-c577d20fe1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.239127 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-3a5994ea-968b-4f63-9feb-c577d20fe1d1 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:54.240974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3a5994ea-968b-4f63-9feb-c577d20fe1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:54.307815 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1412/2801] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:54.316905 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd2549-bb12-46ae-8fa1-c2940ee77ae7 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.317325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd2549-bb12-46ae-8fa1-c2940ee77ae7 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.317730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd2549-bb12-46ae-8fa1-c2940ee77ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.337683 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-bccd2549-bb12-46ae-8fa1-c2940ee77ae7 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:54.338928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-bccd2549-bb12-46ae-8fa1-c2940ee77ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:54.347776 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1390/2802] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:54.352112 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5994ea-968b-4f63-9feb-c577d20fe1d1 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.361914 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5994ea-968b-4f63-9feb-c577d20fe1d1 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.366833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce702-dac9-4b8e-ab2b-f5311871112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.367457 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce702-dac9-4b8e-ab2b-f5311871112e admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.367757 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce702-dac9-4b8e-ab2b-f5311871112e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.368026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce702-dac9-4b8e-ab2b-f5311871112e admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.368779 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ce702-dac9-4b8e-ab2b-f5311871112e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:03:54.369080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ce702-dac9-4b8e-ab2b-f5311871112e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.370706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ce702-dac9-4b8e-ab2b-f5311871112e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.382325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1413/2803] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:03:54.388326 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd2549-bb12-46ae-8fa1-c2940ee77ae7 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.398198 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd2549-bb12-46ae-8fa1-c2940ee77ae7 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.403975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a901ccb-3358-499e-9045-53c7a114a286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.404622 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a901ccb-3358-499e-9045-53c7a114a286 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.404899 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a901ccb-3358-499e-9045-53c7a114a286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.405168 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a901ccb-3358-499e-9045-53c7a114a286 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.405882 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a901ccb-3358-499e-9045-53c7a114a286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.407840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a901ccb-3358-499e-9045-53c7a114a286 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.438531 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1391/2804] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:54 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:54.442717 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce702-dac9-4b8e-ab2b-f5311871112e admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.453192 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce702-dac9-4b8e-ab2b-f5311871112e admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.510326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fc980-c45d-476c-bcb8-040b49c31d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.510994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fc980-c45d-476c-bcb8-040b49c31d4a admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.511257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fc980-c45d-476c-bcb8-040b49c31d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.511507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fc980-c45d-476c-bcb8-040b49c31d4a admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.512203 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fc980-c45d-476c-bcb8-040b49c31d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.514189 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fc980-c45d-476c-bcb8-040b49c31d4a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.540730 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1414/2805] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:54 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:03:54.545087 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a901ccb-3358-499e-9045-53c7a114a286 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.556033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a901ccb-3358-499e-9045-53c7a114a286 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.561992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82aa07-ca86-42cf-9200-4eb25662416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.562722 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82aa07-ca86-42cf-9200-4eb25662416c admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.563008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82aa07-ca86-42cf-9200-4eb25662416c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.563270 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82aa07-ca86-42cf-9200-4eb25662416c admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.564003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82aa07-ca86-42cf-9200-4eb25662416c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.565609 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82aa07-ca86-42cf-9200-4eb25662416c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.576043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1392/2806] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:54.580194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fc980-c45d-476c-bcb8-040b49c31d4a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.591314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fc980-c45d-476c-bcb8-040b49c31d4a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.597490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dc586-a0a7-4dce-aa74-23c2b76e6951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.598164 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dc586-a0a7-4dce-aa74-23c2b76e6951 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.598441 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dc586-a0a7-4dce-aa74-23c2b76e6951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.598712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dc586-a0a7-4dce-aa74-23c2b76e6951 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.599437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dc586-a0a7-4dce-aa74-23c2b76e6951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.601094 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dc586-a0a7-4dce-aa74-23c2b76e6951 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.611703 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1415/2807] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:54.617081 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82aa07-ca86-42cf-9200-4eb25662416c admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.627368 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82aa07-ca86-42cf-9200-4eb25662416c admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.633566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c599803-c77f-4882-8b4d-3a86418ee29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.634479 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c599803-c77f-4882-8b4d-3a86418ee29b admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.634759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c599803-c77f-4882-8b4d-3a86418ee29b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.635036 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c599803-c77f-4882-8b4d-3a86418ee29b admin admin] PATH_INFO: `/v3/projects/a4c00536e8774c24a30245f85f1ee2cb/users/50ab8d5b02a14652944662506fc935fb/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.651256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c599803-c77f-4882-8b4d-3a86418ee29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c00536e8774c24a30245f85f1ee2cb, user_id=50ab8d5b02a14652944662506fc935fb, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.653988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c599803-c77f-4882-8b4d-3a86418ee29b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.669447 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1393/2808] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:54 2022] PUT /identity/v3/projects/a4c00536e8774c24a30245f85f1ee2cb/users/50ab8d5b02a14652944662506fc935fb/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:03:54.682149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b11e-23c6-44be-8886-2a2a94ca9b6d None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.682521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b11e-23c6-44be-8886-2a2a94ca9b6d None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.682838 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b11e-23c6-44be-8886-2a2a94ca9b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.718398 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-9431b11e-23c6-44be-8886-2a2a94ca9b6d None None] MFA Rules not processed for user `50ab8d5b02a14652944662506fc935fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:54.719543 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-9431b11e-23c6-44be-8886-2a2a94ca9b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:54.782735 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1416/2809] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:54.793838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c599803-c77f-4882-8b4d-3a86418ee29b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.795972 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0c599803-c77f-4882-8b4d-3a86418ee29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:54.855126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c599803-c77f-4882-8b4d-3a86418ee29b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.859241 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcbecd-6835-4d88-87a4-11f00476878b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.859888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcbecd-6835-4d88-87a4-11f00476878b service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.860172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcbecd-6835-4d88-87a4-11f00476878b service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.860430 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcbecd-6835-4d88-87a4-11f00476878b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.869761 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcbecd-6835-4d88-87a4-11f00476878b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.871268 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcbecd-6835-4d88-87a4-11f00476878b service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.880671 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1394/2810] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:03.306566 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b11e-23c6-44be-8886-2a2a94ca9b6d None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:03.377978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b11e-23c6-44be-8886-2a2a94ca9b6d None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:03.384108 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:03.384986 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:03.385267 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:03.385542 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] PATH_INFO: `/v3/users/50ab8d5b02a14652944662506fc935fb` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:03.386761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ab8d5b02a14652944662506fc935fb)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:03.388697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:03.438125 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ab8d5b02a14652944662506fc935fb'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:03.449651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ab8d5b02a14652944662506fc935fb'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:03.450369 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ab8d5b02a14652944662506fc935fb'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:03.451036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ab8d5b02a14652944662506fc935fb'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:03.461419 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ab8d5b02a14652944662506fc935fb'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:03.474554 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1417/2811] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:03 2022] DELETE /identity/v3/users/50ab8d5b02a14652944662506fc935fb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:03.479555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dc9ba-7aa0-4feb-bcbc-6c157c36f0c6 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:03.480049 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dc9ba-7aa0-4feb-bcbc-6c157c36f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:03.480209 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dc9ba-7aa0-4feb-bcbc-6c157c36f0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:03.498119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-602dc9ba-7aa0-4feb-bcbc-6c157c36f0c6 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:03.499325 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-602dc9ba-7aa0-4feb-bcbc-6c157c36f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:03.559238 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1395/2812] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:03.569156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:03.570781 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:03.638825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde41727-617d-4c1e-8d60-8cfce8cd1954 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:03.643240 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af4d07-9957-46cb-978a-002e1fdac8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:03.643915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af4d07-9957-46cb-978a-002e1fdac8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:03.644147 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af4d07-9957-46cb-978a-002e1fdac8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:03.644436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af4d07-9957-46cb-978a-002e1fdac8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:03.653904 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af4d07-9957-46cb-978a-002e1fdac8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:03.655379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af4d07-9957-46cb-978a-002e1fdac8b6 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:03.664810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1418/2813] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:03.931478 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dc9ba-7aa0-4feb-bcbc-6c157c36f0c6 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:03.932944 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-602dc9ba-7aa0-4feb-bcbc-6c157c36f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:03.946653 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dc9ba-7aa0-4feb-bcbc-6c157c36f0c6 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:03.951414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:03.952940 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:03.953223 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:03.953501 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] PATH_INFO: `/v3/projects/a4c00536e8774c24a30245f85f1ee2cb` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:03.954891 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c00536e8774c24a30245f85f1ee2cb)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:03.956793 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.005906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c00536e8774c24a30245f85f1ee2cb', 'request_id': 'req-1260afd5-1f2d-4c06-a537-127e21df5d14'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.012185 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c00536e8774c24a30245f85f1ee2cb', 'request_id': 'req-1260afd5-1f2d-4c06-a537-127e21df5d14'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.020798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c00536e8774c24a30245f85f1ee2cb', 'request_id': 'req-1260afd5-1f2d-4c06-a537-127e21df5d14'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.030827 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] The token cache is being invalidate because project a4c00536e8774c24a30245f85f1ee2cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:04.031111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.031717 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-1260afd5-1f2d-4c06-a537-127e21df5d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.033230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1396/2814] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:03 2022] DELETE /identity/v3/projects/a4c00536e8774c24a30245f85f1ee2cb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:04.038252 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142b70-c1ea-447e-b253-a2f9f3e78220 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.038544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142b70-c1ea-447e-b253-a2f9f3e78220 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.038824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142b70-c1ea-447e-b253-a2f9f3e78220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.057196 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-50142b70-c1ea-447e-b253-a2f9f3e78220 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:04.058437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-50142b70-c1ea-447e-b253-a2f9f3e78220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:04.121471 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1419/2815] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:04.129367 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb143-5152-413a-b90e-b0de5e6410b3 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.129654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb143-5152-413a-b90e-b0de5e6410b3 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.129934 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb143-5152-413a-b90e-b0de5e6410b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.149459 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f76cb143-5152-413a-b90e-b0de5e6410b3 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:04.150676 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f76cb143-5152-413a-b90e-b0de5e6410b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:04.159108 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1397/2816] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:04.163865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50142b70-c1ea-447e-b253-a2f9f3e78220 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.179851 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50142b70-c1ea-447e-b253-a2f9f3e78220 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.188551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44164-7d18-4ef7-88bc-b578957fe5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.189408 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44164-7d18-4ef7-88bc-b578957fe5dd admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.189751 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44164-7d18-4ef7-88bc-b578957fe5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.190155 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44164-7d18-4ef7-88bc-b578957fe5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.191200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44164-7d18-4ef7-88bc-b578957fe5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91690) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:04.191597 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44164-7d18-4ef7-88bc-b578957fe5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.194143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44164-7d18-4ef7-88bc-b578957fe5dd admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.206888 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1420/2817] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:04.211474 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cb143-5152-413a-b90e-b0de5e6410b3 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.221055 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cb143-5152-413a-b90e-b0de5e6410b3 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.227161 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e9e2f-222e-4cfc-ba24-eeb9b654ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.227816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e9e2f-222e-4cfc-ba24-eeb9b654ffb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.228096 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e9e2f-222e-4cfc-ba24-eeb9b654ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.228365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e9e2f-222e-4cfc-ba24-eeb9b654ffb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.229056 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e9e2f-222e-4cfc-ba24-eeb9b654ffb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.231008 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e9e2f-222e-4cfc-ba24-eeb9b654ffb1 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.260437 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1398/2818] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:04 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:04.264753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44164-7d18-4ef7-88bc-b578957fe5dd admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.274824 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44164-7d18-4ef7-88bc-b578957fe5dd admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.330665 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636c13b-afd9-46e4-9199-e62d5e885831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.331356 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636c13b-afd9-46e4-9199-e62d5e885831 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.331595 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636c13b-afd9-46e4-9199-e62d5e885831 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.331863 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636c13b-afd9-46e4-9199-e62d5e885831 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.332551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636c13b-afd9-46e4-9199-e62d5e885831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.334530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636c13b-afd9-46e4-9199-e62d5e885831 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.355505 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1421/2819] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:04 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:04.359841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e9e2f-222e-4cfc-ba24-eeb9b654ffb1 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.370607 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e9e2f-222e-4cfc-ba24-eeb9b654ffb1 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.376022 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931979b7-420d-4d59-a325-e2b82df436ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.376632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931979b7-420d-4d59-a325-e2b82df436ec admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.376907 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931979b7-420d-4d59-a325-e2b82df436ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.377180 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931979b7-420d-4d59-a325-e2b82df436ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.377910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931979b7-420d-4d59-a325-e2b82df436ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.379558 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931979b7-420d-4d59-a325-e2b82df436ec admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.389913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1399/2820] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:04.393896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636c13b-afd9-46e4-9199-e62d5e885831 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.404569 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636c13b-afd9-46e4-9199-e62d5e885831 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.410030 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5752042-e1c5-4329-b97c-1a389b6da768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.410747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5752042-e1c5-4329-b97c-1a389b6da768 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.411026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5752042-e1c5-4329-b97c-1a389b6da768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.411269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5752042-e1c5-4329-b97c-1a389b6da768 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.411998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5752042-e1c5-4329-b97c-1a389b6da768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.413621 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5752042-e1c5-4329-b97c-1a389b6da768 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.424415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1422/2821] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:04.430581 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931979b7-420d-4d59-a325-e2b82df436ec admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.440494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931979b7-420d-4d59-a325-e2b82df436ec admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.445774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba38d9-0a19-4e29-8db7-b60ae3d7a9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.446688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba38d9-0a19-4e29-8db7-b60ae3d7a9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.446969 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba38d9-0a19-4e29-8db7-b60ae3d7a9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.447242 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba38d9-0a19-4e29-8db7-b60ae3d7a9a9 admin admin] PATH_INFO: `/v3/projects/2246bf8581ef4411a23411f0721af52d/users/44e70bc08b8e4a14a3075f0ffa4c1c00/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.461916 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba38d9-0a19-4e29-8db7-b60ae3d7a9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2246bf8581ef4411a23411f0721af52d, user_id=44e70bc08b8e4a14a3075f0ffa4c1c00, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.464865 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba38d9-0a19-4e29-8db7-b60ae3d7a9a9 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.484460 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1400/2822] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:04 2022] PUT /identity/v3/projects/2246bf8581ef4411a23411f0721af52d/users/44e70bc08b8e4a14a3075f0ffa4c1c00/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:04.496550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88aeb1-a4e7-4d37-9bc9-7d17c5ea1aa9 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.496828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88aeb1-a4e7-4d37-9bc9-7d17c5ea1aa9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.497098 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88aeb1-a4e7-4d37-9bc9-7d17c5ea1aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.525560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-2e88aeb1-a4e7-4d37-9bc9-7d17c5ea1aa9 None None] MFA Rules not processed for user `44e70bc08b8e4a14a3075f0ffa4c1c00`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:04.526776 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2e88aeb1-a4e7-4d37-9bc9-7d17c5ea1aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:04.593461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1423/2823] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:04.598385 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba38d9-0a19-4e29-8db7-b60ae3d7a9a9 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.666906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba38d9-0a19-4e29-8db7-b60ae3d7a9a9 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.672642 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa6839-4c98-42d5-8734-edad1f2e9a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.673316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa6839-4c98-42d5-8734-edad1f2e9a3d admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.673637 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa6839-4c98-42d5-8734-edad1f2e9a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.673913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa6839-4c98-42d5-8734-edad1f2e9a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.675016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa6839-4c98-42d5-8734-edad1f2e9a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.676937 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa6839-4c98-42d5-8734-edad1f2e9a3d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.706528 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1401/2824] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:04 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:04.712341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88aeb1-a4e7-4d37-9bc9-7d17c5ea1aa9 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.723593 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88aeb1-a4e7-4d37-9bc9-7d17c5ea1aa9 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.786299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d4f0-383d-457c-8e4a-abaf8be13726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.786979 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d4f0-383d-457c-8e4a-abaf8be13726 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.787264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d4f0-383d-457c-8e4a-abaf8be13726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.787548 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d4f0-383d-457c-8e4a-abaf8be13726 admin admin] PATH_INFO: `/v3/users` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.788242 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3d4f0-383d-457c-8e4a-abaf8be13726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.790258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3d4f0-383d-457c-8e4a-abaf8be13726 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.812903 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1424/2825] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:04 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:04.817072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa6839-4c98-42d5-8734-edad1f2e9a3d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.827649 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa6839-4c98-42d5-8734-edad1f2e9a3d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.832704 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495abb96-dd2b-4ead-be10-8f47f2e83217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.833365 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495abb96-dd2b-4ead-be10-8f47f2e83217 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.833646 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495abb96-dd2b-4ead-be10-8f47f2e83217 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.833921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495abb96-dd2b-4ead-be10-8f47f2e83217 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.834678 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495abb96-dd2b-4ead-be10-8f47f2e83217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.836313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495abb96-dd2b-4ead-be10-8f47f2e83217 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.846903 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1402/2826] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:04.851068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d4f0-383d-457c-8e4a-abaf8be13726 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.861599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d4f0-383d-457c-8e4a-abaf8be13726 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.867424 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7f86-44d3-43ba-920d-a715172dd07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.868303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7f86-44d3-43ba-920d-a715172dd07c admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.868576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7f86-44d3-43ba-920d-a715172dd07c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.868849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7f86-44d3-43ba-920d-a715172dd07c admin admin] PATH_INFO: `/v3/projects/6aa471d05b7a43ce9cf80363183d8395/users/4cd14ea265614be2b302d206be7c3074/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.886624 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7f86-44d3-43ba-920d-a715172dd07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa471d05b7a43ce9cf80363183d8395, user_id=4cd14ea265614be2b302d206be7c3074, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.890849 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7f86-44d3-43ba-920d-a715172dd07c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.910404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1425/2827] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:04 2022] PUT /identity/v3/projects/6aa471d05b7a43ce9cf80363183d8395/users/4cd14ea265614be2b302d206be7c3074/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:04.914881 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495abb96-dd2b-4ead-be10-8f47f2e83217 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.925266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495abb96-dd2b-4ead-be10-8f47f2e83217 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.987950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d2300-e950-4280-a45e-db99d3c75e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.988626 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d2300-e950-4280-a45e-db99d3c75e91 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.988883 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d2300-e950-4280-a45e-db99d3c75e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.989142 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d2300-e950-4280-a45e-db99d3c75e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.989892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d2300-e950-4280-a45e-db99d3c75e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.991564 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d2300-e950-4280-a45e-db99d3c75e91 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:05.001698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1403/2828] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:05.006225 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7f86-44d3-43ba-920d-a715172dd07c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:05.017462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7f86-44d3-43ba-920d-a715172dd07c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:05.023415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5204b5-3ddd-45b4-988d-b77cd5f9f0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:05.024346 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5204b5-3ddd-45b4-988d-b77cd5f9f0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:05.024633 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5204b5-3ddd-45b4-988d-b77cd5f9f0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:05.024907 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5204b5-3ddd-45b4-988d-b77cd5f9f0a8 admin admin] PATH_INFO: `/v3/projects/6aa471d05b7a43ce9cf80363183d8395/users/4cd14ea265614be2b302d206be7c3074/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:05.027111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5204b5-3ddd-45b4-988d-b77cd5f9f0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa471d05b7a43ce9cf80363183d8395, user_id=4cd14ea265614be2b302d206be7c3074, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:05.029761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5204b5-3ddd-45b4-988d-b77cd5f9f0a8 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:05.041032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1426/2829] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:05 2022] PUT /identity/v3/projects/6aa471d05b7a43ce9cf80363183d8395/users/4cd14ea265614be2b302d206be7c3074/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:05.051926 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec6d0-ab85-426e-a709-4b5fb3508975 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:05.052208 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec6d0-ab85-426e-a709-4b5fb3508975 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:05.052482 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec6d0-ab85-426e-a709-4b5fb3508975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:05.080275 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-f0aec6d0-ab85-426e-a709-4b5fb3508975 None None] MFA Rules not processed for user `4cd14ea265614be2b302d206be7c3074`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:05.081468 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f0aec6d0-ab85-426e-a709-4b5fb3508975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:05.156453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1404/2830] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:05.169215 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5204b5-3ddd-45b4-988d-b77cd5f9f0a8 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:05.171119 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6e5204b5-3ddd-45b4-988d-b77cd5f9f0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:05.232030 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5204b5-3ddd-45b4-988d-b77cd5f9f0a8 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:05.238142 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea8783-0082-42e3-adc0-87a17eefd263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:05.239111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea8783-0082-42e3-adc0-87a17eefd263 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:05.239581 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea8783-0082-42e3-adc0-87a17eefd263 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:05.239981 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea8783-0082-42e3-adc0-87a17eefd263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:05.251100 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea8783-0082-42e3-adc0-87a17eefd263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:05.252544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea8783-0082-42e3-adc0-87a17eefd263 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:05.262074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1427/2831] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:05.579175 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aec6d0-ab85-426e-a709-4b5fb3508975 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:05.588669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aec6d0-ab85-426e-a709-4b5fb3508975 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:05.595200 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c86c-b5dd-4a68-b83d-91f91648fac6 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd14ea265614be2b302d206be7c3074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6aa471d05b7a43ce9cf80363183d8395', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:05.596073 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c86c-b5dd-4a68-b83d-91f91648fac6 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:05.596352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c86c-b5dd-4a68-b83d-91f91648fac6 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:05.596627 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c86c-b5dd-4a68-b83d-91f91648fac6 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:05.597684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c86c-b5dd-4a68-b83d-91f91648fac6 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:05.598040 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c86c-b5dd-4a68-b83d-91f91648fac6 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:05.600449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c86c-b5dd-4a68-b83d-91f91648fac6 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:05.613172 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1405/2832] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:05.617788 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea8783-0082-42e3-adc0-87a17eefd263 service cinder] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:05.627557 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea8783-0082-42e3-adc0-87a17eefd263 service cinder] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:05.632953 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479e89e-ff88-4a02-b280-65a704d8d47b tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd14ea265614be2b302d206be7c3074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6aa471d05b7a43ce9cf80363183d8395', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:05.633654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e89e-ff88-4a02-b280-65a704d8d47b tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:05.633938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e89e-ff88-4a02-b280-65a704d8d47b tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:05.634247 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e89e-ff88-4a02-b280-65a704d8d47b tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:05.634946 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479e89e-ff88-4a02-b280-65a704d8d47b tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:05.636938 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479e89e-ff88-4a02-b280-65a704d8d47b tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:05.663299 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1428/2833] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:05 2022] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:05.667615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c86c-b5dd-4a68-b83d-91f91648fac6 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:05.677793 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c86c-b5dd-4a68-b83d-91f91648fac6 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:05.733561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18314c57-0a6b-4610-89e0-6b2031c42fb3 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd14ea265614be2b302d206be7c3074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6aa471d05b7a43ce9cf80363183d8395', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:05.734279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314c57-0a6b-4610-89e0-6b2031c42fb3 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:05.734539 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314c57-0a6b-4610-89e0-6b2031c42fb3 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:05.734803 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314c57-0a6b-4610-89e0-6b2031c42fb3 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:05.735538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18314c57-0a6b-4610-89e0-6b2031c42fb3 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:05.735841 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18314c57-0a6b-4610-89e0-6b2031c42fb3 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:05.737440 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18314c57-0a6b-4610-89e0-6b2031c42fb3 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:05.748486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1406/2834] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:05.785032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479e89e-ff88-4a02-b280-65a704d8d47b tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:05.795684 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479e89e-ff88-4a02-b280-65a704d8d47b tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:05.801193 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd14ea265614be2b302d206be7c3074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6aa471d05b7a43ce9cf80363183d8395', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:05.802063 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:05.802381 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:05.802654 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] PATH_INFO: `/v3/projects/ce8f6af69b2146a1a458c93934b9ca7a` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:05.803874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce8f6af69b2146a1a458c93934b9ca7a)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:05.805789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:05.855335 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8f6af69b2146a1a458c93934b9ca7a', 'request_id': 'req-ac101ee4-511e-459e-b2b6-62d0626d2558'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.861689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8f6af69b2146a1a458c93934b9ca7a', 'request_id': 'req-ac101ee4-511e-459e-b2b6-62d0626d2558'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.870567 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8f6af69b2146a1a458c93934b9ca7a', 'request_id': 'req-ac101ee4-511e-459e-b2b6-62d0626d2558'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.881502 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] The token cache is being invalidate because project ce8f6af69b2146a1a458c93934b9ca7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:05.881818 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.882659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-ac101ee4-511e-459e-b2b6-62d0626d2558 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.884762 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1429/2835] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:05 2022] DELETE /identity/v3/projects/ce8f6af69b2146a1a458c93934b9ca7a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:06.087450 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18314c57-0a6b-4610-89e0-6b2031c42fb3 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.089307 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-18314c57-0a6b-4610-89e0-6b2031c42fb3 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:06.155069 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18314c57-0a6b-4610-89e0-6b2031c42fb3 tempest-VolumeQuotaClassesTest-850268661 tempest-VolumeQuotaClassesTest-850268661-project-admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.213960 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.214907 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.215160 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.215426 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] PATH_INFO: `/v3/users/44e70bc08b8e4a14a3075f0ffa4c1c00` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.216737 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e70bc08b8e4a14a3075f0ffa4c1c00)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.218733 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.266772 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e70bc08b8e4a14a3075f0ffa4c1c00'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.278070 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e70bc08b8e4a14a3075f0ffa4c1c00'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.278771 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e70bc08b8e4a14a3075f0ffa4c1c00'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.287176 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e70bc08b8e4a14a3075f0ffa4c1c00'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.287825 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e70bc08b8e4a14a3075f0ffa4c1c00'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.300621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1407/2836] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:06 2022] DELETE /identity/v3/users/44e70bc08b8e4a14a3075f0ffa4c1c00 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:06.305312 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d23c9-d88c-476b-92c7-7899bf7629dd None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.305730 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d23c9-d88c-476b-92c7-7899bf7629dd None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.306026 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d23c9-d88c-476b-92c7-7899bf7629dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.324414 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-337d23c9-d88c-476b-92c7-7899bf7629dd None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:06.325544 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-337d23c9-d88c-476b-92c7-7899bf7629dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:06.389066 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1430/2837] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:06.399227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.400569 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:06.460159 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d61e7-26d2-4028-b277-567ac869ac81 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.464134 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72b53-e241-4ba3-afcb-a70824741680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.464769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b53-e241-4ba3-afcb-a70824741680 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.465046 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b53-e241-4ba3-afcb-a70824741680 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.465312 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b53-e241-4ba3-afcb-a70824741680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.474872 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab72b53-e241-4ba3-afcb-a70824741680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.476302 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab72b53-e241-4ba3-afcb-a70824741680 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.485783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1408/2838] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:06.767492 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d23c9-d88c-476b-92c7-7899bf7629dd None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.768960 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-337d23c9-d88c-476b-92c7-7899bf7629dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:06.784846 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d23c9-d88c-476b-92c7-7899bf7629dd None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.790726 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.791537 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.791868 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.792080 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] PATH_INFO: `/v3/projects/2246bf8581ef4411a23411f0721af52d` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.793619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2246bf8581ef4411a23411f0721af52d)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.795475 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.843354 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2246bf8581ef4411a23411f0721af52d', 'request_id': 'req-c27874c2-9eb3-4bf8-8548-27d3332e603e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.849307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2246bf8581ef4411a23411f0721af52d', 'request_id': 'req-c27874c2-9eb3-4bf8-8548-27d3332e603e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.858796 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2246bf8581ef4411a23411f0721af52d', 'request_id': 'req-c27874c2-9eb3-4bf8-8548-27d3332e603e'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.868792 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] The token cache is being invalidate because project 2246bf8581ef4411a23411f0721af52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:06.869069 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.869690 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.871271 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1431/2839] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:06 2022] DELETE /identity/v3/projects/2246bf8581ef4411a23411f0721af52d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:06.877015 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72b53-e241-4ba3-afcb-a70824741680 service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.887154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72b53-e241-4ba3-afcb-a70824741680 service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.944890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.945807 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.946122 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.946379 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] PATH_INFO: `/v3/users/4cd14ea265614be2b302d206be7c3074` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.947845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd14ea265614be2b302d206be7c3074)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.949775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.997348 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd14ea265614be2b302d206be7c3074'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:07.009084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd14ea265614be2b302d206be7c3074'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:07.009812 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd14ea265614be2b302d206be7c3074'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:07.019414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd14ea265614be2b302d206be7c3074'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:07.020149 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-9f0472f3-f835-4641-bb66-b0b37d7bb870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd14ea265614be2b302d206be7c3074'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:07.032111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1409/2840] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:06 2022] DELETE /identity/v3/users/4cd14ea265614be2b302d206be7c3074 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:07.306490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.308068 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:07.323364 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27874c2-9eb3-4bf8-8548-27d3332e603e admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.382424 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.383219 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.383571 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.383840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] PATH_INFO: `/v3/projects/6aa471d05b7a43ce9cf80363183d8395` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.385056 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa471d05b7a43ce9cf80363183d8395)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.387096 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.435490 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa471d05b7a43ce9cf80363183d8395', 'request_id': 'req-a060a512-f92a-4a0e-ae83-887245478afe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:07.441306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa471d05b7a43ce9cf80363183d8395', 'request_id': 'req-a060a512-f92a-4a0e-ae83-887245478afe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:07.450994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa471d05b7a43ce9cf80363183d8395', 'request_id': 'req-a060a512-f92a-4a0e-ae83-887245478afe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:07.462517 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] The token cache is being invalidate because project 6aa471d05b7a43ce9cf80363183d8395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:07.462799 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:07.463444 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-a060a512-f92a-4a0e-ae83-887245478afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:07.465041 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1432/2841] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:07 2022] DELETE /identity/v3/projects/6aa471d05b7a43ce9cf80363183d8395 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:07.470243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c58d-1e6a-4efd-a35c-03f9c44726bf None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.470538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c58d-1e6a-4efd-a35c-03f9c44726bf None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.470816 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c58d-1e6a-4efd-a35c-03f9c44726bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.489057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d220c58d-1e6a-4efd-a35c-03f9c44726bf None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:07.490291 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d220c58d-1e6a-4efd-a35c-03f9c44726bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:07.548057 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1410/2842] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:07.556693 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9b9a-4c3e-4bc7-890d-b97527f9b79b None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.557032 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9b9a-4c3e-4bc7-890d-b97527f9b79b None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.557343 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9b9a-4c3e-4bc7-890d-b97527f9b79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.575530 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-14fd9b9a-4c3e-4bc7-890d-b97527f9b79b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:07.576727 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-14fd9b9a-4c3e-4bc7-890d-b97527f9b79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:07.585020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1433/2843] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:07.589687 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c58d-1e6a-4efd-a35c-03f9c44726bf None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.602145 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c58d-1e6a-4efd-a35c-03f9c44726bf None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.610356 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152936a-5879-4bf2-b8a6-c555512d8c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.611316 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152936a-5879-4bf2-b8a6-c555512d8c2b admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.611670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152936a-5879-4bf2-b8a6-c555512d8c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.612005 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152936a-5879-4bf2-b8a6-c555512d8c2b admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.612847 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152936a-5879-4bf2-b8a6-c555512d8c2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:07.613203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152936a-5879-4bf2-b8a6-c555512d8c2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.615313 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152936a-5879-4bf2-b8a6-c555512d8c2b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.628228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1411/2844] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:07.632829 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd9b9a-4c3e-4bc7-890d-b97527f9b79b None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.642301 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd9b9a-4c3e-4bc7-890d-b97527f9b79b None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.648140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f9109-9ca2-42b1-89f3-ed2eaa3511ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.648797 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9109-9ca2-42b1-89f3-ed2eaa3511ca admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.649168 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9109-9ca2-42b1-89f3-ed2eaa3511ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.649436 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9109-9ca2-42b1-89f3-ed2eaa3511ca admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.650117 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f9109-9ca2-42b1-89f3-ed2eaa3511ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.652058 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f9109-9ca2-42b1-89f3-ed2eaa3511ca admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.679476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1434/2845] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:07 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:07.684013 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152936a-5879-4bf2-b8a6-c555512d8c2b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.694317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152936a-5879-4bf2-b8a6-c555512d8c2b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.752317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211260-4ede-4d17-88af-fead803d4d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.752983 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211260-4ede-4d17-88af-fead803d4d66 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.753262 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211260-4ede-4d17-88af-fead803d4d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.753535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211260-4ede-4d17-88af-fead803d4d66 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.754267 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211260-4ede-4d17-88af-fead803d4d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.756199 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211260-4ede-4d17-88af-fead803d4d66 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.778277 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1412/2846] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:07 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:07.782723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f9109-9ca2-42b1-89f3-ed2eaa3511ca admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.793317 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f9109-9ca2-42b1-89f3-ed2eaa3511ca admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.798374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349c7b-100f-4a0f-ade8-a7e4ed45c6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.799043 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349c7b-100f-4a0f-ade8-a7e4ed45c6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.799326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349c7b-100f-4a0f-ade8-a7e4ed45c6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.799601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349c7b-100f-4a0f-ade8-a7e4ed45c6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.800706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d349c7b-100f-4a0f-ade8-a7e4ed45c6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.802351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d349c7b-100f-4a0f-ade8-a7e4ed45c6e9 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.812828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1435/2847] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:07.816964 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211260-4ede-4d17-88af-fead803d4d66 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.827511 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211260-4ede-4d17-88af-fead803d4d66 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.833002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204a5c-cfab-4730-aacf-17378ecfd154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.833643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204a5c-cfab-4730-aacf-17378ecfd154 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.833919 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204a5c-cfab-4730-aacf-17378ecfd154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.834221 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204a5c-cfab-4730-aacf-17378ecfd154 admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.834950 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204a5c-cfab-4730-aacf-17378ecfd154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.836542 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204a5c-cfab-4730-aacf-17378ecfd154 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.846744 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1413/2848] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:07.850925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349c7b-100f-4a0f-ade8-a7e4ed45c6e9 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.861027 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349c7b-100f-4a0f-ade8-a7e4ed45c6e9 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.865651 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2bd00-2586-430a-947d-0e51a67a29d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.866573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2bd00-2586-430a-947d-0e51a67a29d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.866855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2bd00-2586-430a-947d-0e51a67a29d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.867122 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2bd00-2586-430a-947d-0e51a67a29d8 admin admin] PATH_INFO: `/v3/projects/2f1dc40c73344cae9411b68eff7efd6c/users/c075d93ff7884a67a14e2965557f594f/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.881646 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2bd00-2586-430a-947d-0e51a67a29d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1dc40c73344cae9411b68eff7efd6c, user_id=c075d93ff7884a67a14e2965557f594f, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.884460 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2bd00-2586-430a-947d-0e51a67a29d8 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.901574 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1436/2849] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:07 2022] PUT /identity/v3/projects/2f1dc40c73344cae9411b68eff7efd6c/users/c075d93ff7884a67a14e2965557f594f/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:07.969495 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0750141-b075-494b-a32e-fca066274ebf None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.970116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0750141-b075-494b-a32e-fca066274ebf None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.970116 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0750141-b075-494b-a32e-fca066274ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.004079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d0750141-b075-494b-a32e-fca066274ebf None None] MFA Rules not processed for user `c075d93ff7884a67a14e2965557f594f`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:08.005900 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d0750141-b075-494b-a32e-fca066274ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:08.078644 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1414/2850] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:08.083773 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2bd00-2586-430a-947d-0e51a67a29d8 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:08.145833 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2bd00-2586-430a-947d-0e51a67a29d8 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:08.151000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac54b3-b6c7-4032-9e44-d6116cd76237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:08.151698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac54b3-b6c7-4032-9e44-d6116cd76237 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.151977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac54b3-b6c7-4032-9e44-d6116cd76237 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.152249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac54b3-b6c7-4032-9e44-d6116cd76237 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.152896 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac54b3-b6c7-4032-9e44-d6116cd76237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:08.154871 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac54b3-b6c7-4032-9e44-d6116cd76237 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.181761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1437/2851] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:08 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:08.186317 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0750141-b075-494b-a32e-fca066274ebf None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:08.197873 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0750141-b075-494b-a32e-fca066274ebf None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:08.263146 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2e4f7-e48f-46ec-8016-623c5f08ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:08.263819 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2e4f7-e48f-46ec-8016-623c5f08ed25 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.264111 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2e4f7-e48f-46ec-8016-623c5f08ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.264377 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2e4f7-e48f-46ec-8016-623c5f08ed25 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.265061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2e4f7-e48f-46ec-8016-623c5f08ed25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:08.267037 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2e4f7-e48f-46ec-8016-623c5f08ed25 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.291654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1415/2852] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:08 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:08.297179 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac54b3-b6c7-4032-9e44-d6116cd76237 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:08.308935 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac54b3-b6c7-4032-9e44-d6116cd76237 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:08.313746 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1f11d-d6a8-4921-b6fc-da0defa48426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:08.314454 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1f11d-d6a8-4921-b6fc-da0defa48426 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.314723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1f11d-d6a8-4921-b6fc-da0defa48426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.314989 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1f11d-d6a8-4921-b6fc-da0defa48426 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.315718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1f11d-d6a8-4921-b6fc-da0defa48426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:08.317323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1f11d-d6a8-4921-b6fc-da0defa48426 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.327809 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1438/2853] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:08.332217 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2e4f7-e48f-46ec-8016-623c5f08ed25 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:08.342697 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2e4f7-e48f-46ec-8016-623c5f08ed25 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:08.347699 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b76db1-cb2b-478d-8ef2-9084d953e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:08.348553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b76db1-cb2b-478d-8ef2-9084d953e45c admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.348829 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b76db1-cb2b-478d-8ef2-9084d953e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.349099 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b76db1-cb2b-478d-8ef2-9084d953e45c admin admin] PATH_INFO: `/v3/projects/7dff0200b0854942b2e2d4f554fefbc9/users/9b2dbcad3a2840c8bf7a4720b2b4459e/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.363789 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b76db1-cb2b-478d-8ef2-9084d953e45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dff0200b0854942b2e2d4f554fefbc9, user_id=9b2dbcad3a2840c8bf7a4720b2b4459e, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:08.366555 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b76db1-cb2b-478d-8ef2-9084d953e45c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.382557 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1416/2854] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:08 2022] PUT /identity/v3/projects/7dff0200b0854942b2e2d4f554fefbc9/users/9b2dbcad3a2840c8bf7a4720b2b4459e/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:08.386810 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1f11d-d6a8-4921-b6fc-da0defa48426 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:08.397161 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1f11d-d6a8-4921-b6fc-da0defa48426 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:08.455391 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2409bc7-81a2-4dc9-a38c-04092b3cc0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:08.456053 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2409bc7-81a2-4dc9-a38c-04092b3cc0fc admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.456339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2409bc7-81a2-4dc9-a38c-04092b3cc0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.456622 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2409bc7-81a2-4dc9-a38c-04092b3cc0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.457342 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2409bc7-81a2-4dc9-a38c-04092b3cc0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:08.458982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2409bc7-81a2-4dc9-a38c-04092b3cc0fc admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.468949 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1439/2855] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:08.473273 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b76db1-cb2b-478d-8ef2-9084d953e45c admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:08.483611 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b76db1-cb2b-478d-8ef2-9084d953e45c admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:08.488894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f217b3-b5ce-4399-9968-bd4e6f170cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:08.489808 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f217b3-b5ce-4399-9968-bd4e6f170cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.490107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f217b3-b5ce-4399-9968-bd4e6f170cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.490395 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f217b3-b5ce-4399-9968-bd4e6f170cc1 admin admin] PATH_INFO: `/v3/projects/7dff0200b0854942b2e2d4f554fefbc9/users/9b2dbcad3a2840c8bf7a4720b2b4459e/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.492612 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f217b3-b5ce-4399-9968-bd4e6f170cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dff0200b0854942b2e2d4f554fefbc9, user_id=9b2dbcad3a2840c8bf7a4720b2b4459e, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:08.495393 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f217b3-b5ce-4399-9968-bd4e6f170cc1 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.506030 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1417/2856] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:08 2022] PUT /identity/v3/projects/7dff0200b0854942b2e2d4f554fefbc9/users/9b2dbcad3a2840c8bf7a4720b2b4459e/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:08.516256 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec0e8f-9178-44df-baf2-91629de3b953 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.516543 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec0e8f-9178-44df-baf2-91629de3b953 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.516835 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec0e8f-9178-44df-baf2-91629de3b953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.546479 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-eeec0e8f-9178-44df-baf2-91629de3b953 None None] MFA Rules not processed for user `9b2dbcad3a2840c8bf7a4720b2b4459e`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:08.547685 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-eeec0e8f-9178-44df-baf2-91629de3b953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:08.615698 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1440/2857] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:08.632286 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f217b3-b5ce-4399-9968-bd4e6f170cc1 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:08.634906 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e8f217b3-b5ce-4399-9968-bd4e6f170cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:08.711890 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f217b3-b5ce-4399-9968-bd4e6f170cc1 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:08.716832 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555f067-575f-431f-877d-c12ca4fa6360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:08.717480 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555f067-575f-431f-877d-c12ca4fa6360 service cinder] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.717753 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555f067-575f-431f-877d-c12ca4fa6360 service cinder] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.718020 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555f067-575f-431f-877d-c12ca4fa6360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.728769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555f067-575f-431f-877d-c12ca4fa6360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:08.730227 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555f067-575f-431f-877d-c12ca4fa6360 service cinder] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.739913 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1418/2858] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:08.828313 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec0e8f-9178-44df-baf2-91629de3b953 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:08.838503 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec0e8f-9178-44df-baf2-91629de3b953 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:08.843071 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceb380-5bdd-4e06-86f9-1510e7b7dd1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:08.843719 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb380-5bdd-4e06-86f9-1510e7b7dd1d service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.843998 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb380-5bdd-4e06-86f9-1510e7b7dd1d service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.844270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb380-5bdd-4e06-86f9-1510e7b7dd1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.905001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eceb380-5bdd-4e06-86f9-1510e7b7dd1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:08.906483 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eceb380-5bdd-4e06-86f9-1510e7b7dd1d service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.915630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1441/2859] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:13.710805 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555f067-575f-431f-877d-c12ca4fa6360 service cinder] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:13.772748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555f067-575f-431f-877d-c12ca4fa6360 service cinder] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:13.778599 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:13.779436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:13.779715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:13.780010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] PATH_INFO: `/v3/users/c075d93ff7884a67a14e2965557f594f` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:13.781269 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c075d93ff7884a67a14e2965557f594f)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:13.783230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:13.833942 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c075d93ff7884a67a14e2965557f594f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:13.845296 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c075d93ff7884a67a14e2965557f594f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:13.846016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c075d93ff7884a67a14e2965557f594f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:13.855591 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c075d93ff7884a67a14e2965557f594f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:13.856349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c075d93ff7884a67a14e2965557f594f'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:13.869798 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1419/2860] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:13 2022] DELETE /identity/v3/users/c075d93ff7884a67a14e2965557f594f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:13.875237 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bd0a6-1c5b-4fd6-b986-532266f7ec23 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:13.875749 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bd0a6-1c5b-4fd6-b986-532266f7ec23 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:13.875865 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bd0a6-1c5b-4fd6-b986-532266f7ec23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:13.895287 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-308bd0a6-1c5b-4fd6-b986-532266f7ec23 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:13.896482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-308bd0a6-1c5b-4fd6-b986-532266f7ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:13.962295 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1442/2861] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:13.972453 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:13.974075 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:14.032958 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7164639-2c5b-407d-b772-906dcf3d099a admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:14.036992 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e379e-5902-4c03-ae15-6378e60b610b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:14.037632 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e379e-5902-4c03-ae15-6378e60b610b service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:14.037909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e379e-5902-4c03-ae15-6378e60b610b service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:14.038205 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e379e-5902-4c03-ae15-6378e60b610b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:14.047549 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e379e-5902-4c03-ae15-6378e60b610b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:14.048991 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e379e-5902-4c03-ae15-6378e60b610b service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:14.058684 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1420/2862] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:14.340789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bd0a6-1c5b-4fd6-b986-532266f7ec23 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:14.342484 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-308bd0a6-1c5b-4fd6-b986-532266f7ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:14.358617 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bd0a6-1c5b-4fd6-b986-532266f7ec23 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:14.363728 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:14.364599 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:14.364806 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:14.365076 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] PATH_INFO: `/v3/projects/2f1dc40c73344cae9411b68eff7efd6c` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:14.366389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1dc40c73344cae9411b68eff7efd6c)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:14.368307 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:14.414671 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1dc40c73344cae9411b68eff7efd6c', 'request_id': 'req-eb15d8ca-a0e7-4477-a2f7-64ced6102403'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:14.421238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1dc40c73344cae9411b68eff7efd6c', 'request_id': 'req-eb15d8ca-a0e7-4477-a2f7-64ced6102403'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:14.429397 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1dc40c73344cae9411b68eff7efd6c', 'request_id': 'req-eb15d8ca-a0e7-4477-a2f7-64ced6102403'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:14.439556 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] The token cache is being invalidate because project 2f1dc40c73344cae9411b68eff7efd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:14.439840 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:14.440458 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:14.441988 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1443/2863] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:14 2022] DELETE /identity/v3/projects/2f1dc40c73344cae9411b68eff7efd6c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:14.446256 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e379e-5902-4c03-ae15-6378e60b610b service neutron] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:14.456063 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e379e-5902-4c03-ae15-6378e60b610b service neutron] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:14.522359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:14.523594 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:14.524002 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:14.524443 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] PATH_INFO: `/v3/users/9b2dbcad3a2840c8bf7a4720b2b4459e` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:14.526543 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2dbcad3a2840c8bf7a4720b2b4459e)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:14.529466 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:14.580637 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2dbcad3a2840c8bf7a4720b2b4459e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:14.593000 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2dbcad3a2840c8bf7a4720b2b4459e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:14.593721 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2dbcad3a2840c8bf7a4720b2b4459e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:14.602486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2dbcad3a2840c8bf7a4720b2b4459e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:14.603136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-003611d8-7423-4556-b005-b1da72596b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2dbcad3a2840c8bf7a4720b2b4459e'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:14.615059 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1421/2864] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:14 2022] DELETE /identity/v3/users/9b2dbcad3a2840c8bf7a4720b2b4459e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:14.898020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:14.899498 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:14.913075 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15d8ca-a0e7-4477-a2f7-64ced6102403 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:14.972007 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:14.972954 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:14.973241 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:14.973515 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] PATH_INFO: `/v3/projects/7dff0200b0854942b2e2d4f554fefbc9` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:14.974750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dff0200b0854942b2e2d4f554fefbc9)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:14.976659 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:15.025689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dff0200b0854942b2e2d4f554fefbc9', 'request_id': 'req-d472e285-2ce2-4878-87b1-0bfd63c5867f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:15.031976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dff0200b0854942b2e2d4f554fefbc9', 'request_id': 'req-d472e285-2ce2-4878-87b1-0bfd63c5867f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:15.040681 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dff0200b0854942b2e2d4f554fefbc9', 'request_id': 'req-d472e285-2ce2-4878-87b1-0bfd63c5867f'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:15.051036 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] The token cache is being invalidate because project 7dff0200b0854942b2e2d4f554fefbc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:15.051314 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:15.052049 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-d472e285-2ce2-4878-87b1-0bfd63c5867f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:15.053723 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1444/2865] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:14 2022] DELETE /identity/v3/projects/7dff0200b0854942b2e2d4f554fefbc9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:15.059103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34b25-dfbd-4d8d-bd24-f6703161e2ff None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.059617 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34b25-dfbd-4d8d-bd24-f6703161e2ff None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.059715 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d34b25-dfbd-4d8d-bd24-f6703161e2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.078654 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-54d34b25-dfbd-4d8d-bd24-f6703161e2ff None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:15.079845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-54d34b25-dfbd-4d8d-bd24-f6703161e2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:15.139301 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1422/2866] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:15.151175 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e37e3-c3e5-42d7-9031-5d5ff9741c73 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.151372 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e37e3-c3e5-42d7-9031-5d5ff9741c73 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.151643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e37e3-c3e5-42d7-9031-5d5ff9741c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.170821 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ee6e37e3-c3e5-42d7-9031-5d5ff9741c73 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:15.172025 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ee6e37e3-c3e5-42d7-9031-5d5ff9741c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:15.181786 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1445/2867] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:15.186763 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34b25-dfbd-4d8d-bd24-f6703161e2ff None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:15.201785 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d34b25-dfbd-4d8d-bd24-f6703161e2ff None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:15.210800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754c71c-b907-4d6b-bbc2-fa523c6c305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:15.211700 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754c71c-b907-4d6b-bbc2-fa523c6c305c admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.212091 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754c71c-b907-4d6b-bbc2-fa523c6c305c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.212470 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754c71c-b907-4d6b-bbc2-fa523c6c305c admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.213486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754c71c-b907-4d6b-bbc2-fa523c6c305c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:15.213783 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754c71c-b907-4d6b-bbc2-fa523c6c305c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:15.215449 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754c71c-b907-4d6b-bbc2-fa523c6c305c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:15.227154 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1423/2868] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:15.231550 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e37e3-c3e5-42d7-9031-5d5ff9741c73 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:15.240949 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e37e3-c3e5-42d7-9031-5d5ff9741c73 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:15.246652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08a865-e35e-41d1-8a6e-ef0fa926bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:15.247306 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08a865-e35e-41d1-8a6e-ef0fa926bd5c admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.247583 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08a865-e35e-41d1-8a6e-ef0fa926bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.247852 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08a865-e35e-41d1-8a6e-ef0fa926bd5c admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.248546 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08a865-e35e-41d1-8a6e-ef0fa926bd5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:15.250499 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08a865-e35e-41d1-8a6e-ef0fa926bd5c admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:15.283008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1446/2869] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:15 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:15.291663 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754c71c-b907-4d6b-bbc2-fa523c6c305c admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:15.302335 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754c71c-b907-4d6b-bbc2-fa523c6c305c admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:15.360741 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6e5fe-92e5-4fbd-bee7-b368b725870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:15.361399 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6e5fe-92e5-4fbd-bee7-b368b725870d admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.361677 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6e5fe-92e5-4fbd-bee7-b368b725870d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.361948 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6e5fe-92e5-4fbd-bee7-b368b725870d admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.362656 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6e5fe-92e5-4fbd-bee7-b368b725870d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:15.364566 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6e5fe-92e5-4fbd-bee7-b368b725870d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:15.388580 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1424/2870] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:15 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:15.392831 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08a865-e35e-41d1-8a6e-ef0fa926bd5c admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:15.403137 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08a865-e35e-41d1-8a6e-ef0fa926bd5c admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:15.408270 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e3268-6640-43ca-85ca-c52d83459815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:15.408948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3268-6640-43ca-85ca-c52d83459815 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.409234 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3268-6640-43ca-85ca-c52d83459815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.409508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3268-6640-43ca-85ca-c52d83459815 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.410273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e3268-6640-43ca-85ca-c52d83459815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:15.411878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e3268-6640-43ca-85ca-c52d83459815 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:15.422191 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1447/2871] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:15.426698 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6e5fe-92e5-4fbd-bee7-b368b725870d admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:15.436800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6e5fe-92e5-4fbd-bee7-b368b725870d admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:15.441866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a7fb6-94fe-4144-b81c-19a6ff1a752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:15.442559 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a7fb6-94fe-4144-b81c-19a6ff1a752c admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.442838 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a7fb6-94fe-4144-b81c-19a6ff1a752c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.443107 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a7fb6-94fe-4144-b81c-19a6ff1a752c admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.443831 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a7fb6-94fe-4144-b81c-19a6ff1a752c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:15.445471 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a7fb6-94fe-4144-b81c-19a6ff1a752c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:15.455569 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1425/2872] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:15.459739 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e3268-6640-43ca-85ca-c52d83459815 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:15.469825 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e3268-6640-43ca-85ca-c52d83459815 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:15.475198 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6daac-6f41-46b5-90a1-ee1bd63ee422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:15.476065 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6daac-6f41-46b5-90a1-ee1bd63ee422 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.476341 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6daac-6f41-46b5-90a1-ee1bd63ee422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.476608 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6daac-6f41-46b5-90a1-ee1bd63ee422 admin admin] PATH_INFO: `/v3/projects/0b0cb0edfff14fa4aa81db8de53498c4/users/3360e78883dd4326b7c482ad9b553653/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.491149 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6daac-6f41-46b5-90a1-ee1bd63ee422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0cb0edfff14fa4aa81db8de53498c4, user_id=3360e78883dd4326b7c482ad9b553653, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:15.493795 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6daac-6f41-46b5-90a1-ee1bd63ee422 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:15.508361 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1448/2873] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:15 2022] PUT /identity/v3/projects/0b0cb0edfff14fa4aa81db8de53498c4/users/3360e78883dd4326b7c482ad9b553653/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:15.518801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11527dc-7e31-4abe-a6ec-f92defde5252 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.519088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11527dc-7e31-4abe-a6ec-f92defde5252 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.519360 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11527dc-7e31-4abe-a6ec-f92defde5252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.545421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-e11527dc-7e31-4abe-a6ec-f92defde5252 None None] MFA Rules not processed for user `3360e78883dd4326b7c482ad9b553653`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:15.546648 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-e11527dc-7e31-4abe-a6ec-f92defde5252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:15.615727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1426/2874] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:15.628170 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6daac-6f41-46b5-90a1-ee1bd63ee422 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:15.630289 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6ce6daac-6f41-46b5-90a1-ee1bd63ee422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:15.689154 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6daac-6f41-46b5-90a1-ee1bd63ee422 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:15.693083 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666d01-257d-4f06-a33c-c86983e168e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f94515985e244af29f47a49c0dd415ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:15.693721 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666d01-257d-4f06-a33c-c86983e168e9 service glance] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.694000 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666d01-257d-4f06-a33c-c86983e168e9 service glance] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.694300 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666d01-257d-4f06-a33c-c86983e168e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.703265 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e666d01-257d-4f06-a33c-c86983e168e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:15.704752 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e666d01-257d-4f06-a33c-c86983e168e9 service glance] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:15.713922 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1449/2875] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:46.211935 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11527dc-7e31-4abe-a6ec-f92defde5252 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:46.282452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11527dc-7e31-4abe-a6ec-f92defde5252 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:46.288126 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:46.289003 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:46.289279 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:46.289550 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] PATH_INFO: `/v3/users/3360e78883dd4326b7c482ad9b553653` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:46.290886 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3360e78883dd4326b7c482ad9b553653)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:46.292818 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:46.347203 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3360e78883dd4326b7c482ad9b553653'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:46.359165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3360e78883dd4326b7c482ad9b553653'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:46.359840 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3360e78883dd4326b7c482ad9b553653'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:46.368536 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3360e78883dd4326b7c482ad9b553653'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:46.369157 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3360e78883dd4326b7c482ad9b553653'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:46.381079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1427/2876] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:46 2022] DELETE /identity/v3/users/3360e78883dd4326b7c482ad9b553653 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:46.385906 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497a3e-427e-4989-a148-476c72a9cced None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:46.386475 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497a3e-427e-4989-a148-476c72a9cced None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:46.386475 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b497a3e-427e-4989-a148-476c72a9cced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:46.404110 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-3b497a3e-427e-4989-a148-476c72a9cced None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:46.405415 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3b497a3e-427e-4989-a148-476c72a9cced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:46.466700 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1450/2877] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:46.478663 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:46.481010 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:46.541652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67c67d-dedc-466d-b8e4-9c64d77e10b6 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:46.545410 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd43e8-1f0b-4150-8898-5085a5ac87da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:46.546033 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd43e8-1f0b-4150-8898-5085a5ac87da service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:46.546339 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd43e8-1f0b-4150-8898-5085a5ac87da service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:46.546608 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd43e8-1f0b-4150-8898-5085a5ac87da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:46.556652 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd43e8-1f0b-4150-8898-5085a5ac87da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:46.558100 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd43e8-1f0b-4150-8898-5085a5ac87da service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:46.568666 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1428/2878] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:46.843239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497a3e-427e-4989-a148-476c72a9cced None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:46.844980 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-3b497a3e-427e-4989-a148-476c72a9cced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:46.861507 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b497a3e-427e-4989-a148-476c72a9cced None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:46.867862 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:46.868743 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:46.869017 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:46.869323 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] PATH_INFO: `/v3/projects/0b0cb0edfff14fa4aa81db8de53498c4` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:46.870787 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0cb0edfff14fa4aa81db8de53498c4)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:46.873105 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:46.931601 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0cb0edfff14fa4aa81db8de53498c4', 'request_id': 'req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:46.937696 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0cb0edfff14fa4aa81db8de53498c4', 'request_id': 'req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:46.946528 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0cb0edfff14fa4aa81db8de53498c4', 'request_id': 'req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:46.957138 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] The token cache is being invalidate because project 0b0cb0edfff14fa4aa81db8de53498c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:46.957431 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:46.958063 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f3d94cfd-8280-4ce8-b6ea-eb98ffdfb7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:46.959737 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1451/2879] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:46 2022] DELETE /identity/v3/projects/0b0cb0edfff14fa4aa81db8de53498c4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:46.964888 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce614080-84cd-4c8a-8775-56f194e7fd5b None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:46.965170 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce614080-84cd-4c8a-8775-56f194e7fd5b None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:46.965441 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce614080-84cd-4c8a-8775-56f194e7fd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:46.983670 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-ce614080-84cd-4c8a-8775-56f194e7fd5b None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:46.984918 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-ce614080-84cd-4c8a-8775-56f194e7fd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:47.063629 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1429/2880] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:47.071894 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4dfc8-9f50-4125-9537-6bc1dc13aea8 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:47.072182 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4dfc8-9f50-4125-9537-6bc1dc13aea8 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:47.072461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4dfc8-9f50-4125-9537-6bc1dc13aea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:47.092274 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-66e4dfc8-9f50-4125-9537-6bc1dc13aea8 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:47.093584 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-66e4dfc8-9f50-4125-9537-6bc1dc13aea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:47.103766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1452/2881] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:47.108106 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce614080-84cd-4c8a-8775-56f194e7fd5b None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:47.118572 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce614080-84cd-4c8a-8775-56f194e7fd5b None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:47.124136 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24abc-3f09-4663-8501-2ca470c32f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:47.124794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24abc-3f09-4663-8501-2ca470c32f77 admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:47.125079 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24abc-3f09-4663-8501-2ca470c32f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:47.125353 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24abc-3f09-4663-8501-2ca470c32f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:47.126101 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24abc-3f09-4663-8501-2ca470c32f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:47.126415 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24abc-3f09-4663-8501-2ca470c32f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:47.128021 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24abc-3f09-4663-8501-2ca470c32f77 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:47.140928 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1430/2882] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:47.145367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4dfc8-9f50-4125-9537-6bc1dc13aea8 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:47.155211 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4dfc8-9f50-4125-9537-6bc1dc13aea8 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:47.160286 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d2bbb-d56b-439f-b8f2-75d63157a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:47.160933 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2bbb-d56b-439f-b8f2-75d63157a343 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:47.161217 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2bbb-d56b-439f-b8f2-75d63157a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:47.161491 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2bbb-d56b-439f-b8f2-75d63157a343 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:47.162226 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d2bbb-d56b-439f-b8f2-75d63157a343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:47.164140 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d2bbb-d56b-439f-b8f2-75d63157a343 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:47.192077 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1453/2883] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:47 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:47.196204 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24abc-3f09-4663-8501-2ca470c32f77 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:47.206421 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24abc-3f09-4663-8501-2ca470c32f77 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:47.262865 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3631e-0a31-4553-b24c-7299af304201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:47.263544 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3631e-0a31-4553-b24c-7299af304201 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:47.263800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3631e-0a31-4553-b24c-7299af304201 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:47.264068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3631e-0a31-4553-b24c-7299af304201 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:47.264767 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3631e-0a31-4553-b24c-7299af304201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:47.266747 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3631e-0a31-4553-b24c-7299af304201 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:47.287615 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1431/2884] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:47 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:47.292010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d2bbb-d56b-439f-b8f2-75d63157a343 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:47.303298 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d2bbb-d56b-439f-b8f2-75d63157a343 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:47.308240 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21a854-1338-4ea0-84a7-80bac896f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:47.309200 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21a854-1338-4ea0-84a7-80bac896f8dc admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:47.309495 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21a854-1338-4ea0-84a7-80bac896f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:47.309769 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21a854-1338-4ea0-84a7-80bac896f8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:47.310546 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21a854-1338-4ea0-84a7-80bac896f8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:47.312258 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21a854-1338-4ea0-84a7-80bac896f8dc admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:47.324071 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1454/2885] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:47.328141 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3631e-0a31-4553-b24c-7299af304201 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:47.338439 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3631e-0a31-4553-b24c-7299af304201 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:47.344297 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0e76a-552f-4bff-91a7-2dbe7349825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:47.344954 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e76a-552f-4bff-91a7-2dbe7349825c admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:47.345235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e76a-552f-4bff-91a7-2dbe7349825c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:47.345507 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e76a-552f-4bff-91a7-2dbe7349825c admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:47.346349 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0e76a-552f-4bff-91a7-2dbe7349825c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:47.348102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0e76a-552f-4bff-91a7-2dbe7349825c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:47.358263 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1432/2886] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:47.362466 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21a854-1338-4ea0-84a7-80bac896f8dc admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:47.372718 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21a854-1338-4ea0-84a7-80bac896f8dc admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:47.379100 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571a679-f375-42d4-a132-e0ae725d8c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:47.379976 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a679-f375-42d4-a132-e0ae725d8c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:47.380257 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a679-f375-42d4-a132-e0ae725d8c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:47.380521 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a679-f375-42d4-a132-e0ae725d8c5a admin admin] PATH_INFO: `/v3/projects/b01d867153114d1ca1f36a22dd1e4061/users/2cf0af11fea645ee949baa998f20bb69/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:47.396014 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571a679-f375-42d4-a132-e0ae725d8c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01d867153114d1ca1f36a22dd1e4061, user_id=2cf0af11fea645ee949baa998f20bb69, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:47.398901 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571a679-f375-42d4-a132-e0ae725d8c5a admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:47.414675 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1455/2887] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:47 2022] PUT /identity/v3/projects/b01d867153114d1ca1f36a22dd1e4061/users/2cf0af11fea645ee949baa998f20bb69/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:47.427051 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506ff6a-14fd-4ede-b922-58683869b6f4 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:47.427363 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506ff6a-14fd-4ede-b922-58683869b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:47.427640 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506ff6a-14fd-4ede-b922-58683869b6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:47.455974 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-d506ff6a-14fd-4ede-b922-58683869b6f4 None None] MFA Rules not processed for user `2cf0af11fea645ee949baa998f20bb69`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:47.457184 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-d506ff6a-14fd-4ede-b922-58683869b6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:47.525739 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1433/2888] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:47.536476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571a679-f375-42d4-a132-e0ae725d8c5a admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:47.538707 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-2571a679-f375-42d4-a132-e0ae725d8c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:47.598097 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571a679-f375-42d4-a132-e0ae725d8c5a admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:47.602379 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e7144-8338-4429-bd2f-d1cf83c491a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba2e2211f5d14ebcbd0221278248b868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:47.603037 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e7144-8338-4429-bd2f-d1cf83c491a5 service cinder] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:47.603320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e7144-8338-4429-bd2f-d1cf83c491a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:47.603594 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e7144-8338-4429-bd2f-d1cf83c491a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:47.612309 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e7144-8338-4429-bd2f-d1cf83c491a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:47.613753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e7144-8338-4429-bd2f-d1cf83c491a5 service cinder] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:47.622560 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1456/2889] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:58.064486 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506ff6a-14fd-4ede-b922-58683869b6f4 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:58.155669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506ff6a-14fd-4ede-b922-58683869b6f4 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:58.160929 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:58.161844 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.162119 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.162412 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] PATH_INFO: `/v3/users/2cf0af11fea645ee949baa998f20bb69` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.163769 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf0af11fea645ee949baa998f20bb69)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:58.165696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:58.214812 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf0af11fea645ee949baa998f20bb69'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.228165 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf0af11fea645ee949baa998f20bb69'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.228921 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf0af11fea645ee949baa998f20bb69'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.237494 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf0af11fea645ee949baa998f20bb69'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.238213 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf0af11fea645ee949baa998f20bb69'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.250280 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1434/2890] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:58 2022] DELETE /identity/v3/users/2cf0af11fea645ee949baa998f20bb69 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:58.255090 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebaf47-883a-4e53-a21e-ec1adf03f2a9 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.255577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebaf47-883a-4e53-a21e-ec1adf03f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.255689 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebaf47-883a-4e53-a21e-ec1adf03f2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.305111 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-b8ebaf47-883a-4e53-a21e-ec1adf03f2a9 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:58.306293 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b8ebaf47-883a-4e53-a21e-ec1adf03f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:58.378633 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1457/2891] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:58.390216 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:58.391764 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:58.492628 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bcde5-d5f9-4d58-b196-2080154f747f admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:58.498024 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c03dd-161b-48c7-a779-8f6ced8210e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:58.498713 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c03dd-161b-48c7-a779-8f6ced8210e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.498988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c03dd-161b-48c7-a779-8f6ced8210e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.499266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c03dd-161b-48c7-a779-8f6ced8210e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.509695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c03dd-161b-48c7-a779-8f6ced8210e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:58.511255 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c03dd-161b-48c7-a779-8f6ced8210e3 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:58.521879 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1435/2892] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:58.803817 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebaf47-883a-4e53-a21e-ec1adf03f2a9 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:58.805320 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-b8ebaf47-883a-4e53-a21e-ec1adf03f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:58.817066 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebaf47-883a-4e53-a21e-ec1adf03f2a9 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:58.821766 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:58.822674 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.822948 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.823220 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] PATH_INFO: `/v3/projects/b01d867153114d1ca1f36a22dd1e4061` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.824404 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01d867153114d1ca1f36a22dd1e4061)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:58.826368 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:58.874615 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01d867153114d1ca1f36a22dd1e4061', 'request_id': 'req-08b1c2b9-c020-4243-bcf4-b17732893951'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.880706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01d867153114d1ca1f36a22dd1e4061', 'request_id': 'req-08b1c2b9-c020-4243-bcf4-b17732893951'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.889855 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01d867153114d1ca1f36a22dd1e4061', 'request_id': 'req-08b1c2b9-c020-4243-bcf4-b17732893951'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.899695 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] The token cache is being invalidate because project b01d867153114d1ca1f36a22dd1e4061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91690) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:58.899978 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.900619 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-08b1c2b9-c020-4243-bcf4-b17732893951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.902232 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1458/2893] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:58 2022] DELETE /identity/v3/projects/b01d867153114d1ca1f36a22dd1e4061 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:58.907285 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf7c8-a361-467f-a338-57c07f06a11a None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.907603 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf7c8-a361-467f-a338-57c07f06a11a None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.907880 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf7c8-a361-467f-a338-57c07f06a11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.935854 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-9c8cf7c8-a361-467f-a338-57c07f06a11a None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:58.937040 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-9c8cf7c8-a361-467f-a338-57c07f06a11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:58.999112 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1436/2894] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:59.007269 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740026-ef07-4279-8407-60e10c44f941 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.007677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740026-ef07-4279-8407-60e10c44f941 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.007957 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740026-ef07-4279-8407-60e10c44f941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.027339 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ec740026-ef07-4279-8407-60e10c44f941 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:59.028559 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ec740026-ef07-4279-8407-60e10c44f941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:59.037744 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1459/2895] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:59.043863 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cf7c8-a361-467f-a338-57c07f06a11a None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.058975 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cf7c8-a361-467f-a338-57c07f06a11a None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.067732 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fbb71-6196-4fc0-8a1e-217e1135ce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.068375 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fbb71-6196-4fc0-8a1e-217e1135ce6c admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.068757 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fbb71-6196-4fc0-8a1e-217e1135ce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.069087 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fbb71-6196-4fc0-8a1e-217e1135ce6c admin admin] PATH_INFO: `/v3/domains` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.070230 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fbb71-6196-4fc0-8a1e-217e1135ce6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91691) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:59.070536 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fbb71-6196-4fc0-8a1e-217e1135ce6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.072254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fbb71-6196-4fc0-8a1e-217e1135ce6c admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.083815 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1437/2896] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:59.089374 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740026-ef07-4279-8407-60e10c44f941 None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.100791 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740026-ef07-4279-8407-60e10c44f941 None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.106575 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230a4dd-f54d-45b6-a1c7-1a518d92a590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.107253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230a4dd-f54d-45b6-a1c7-1a518d92a590 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.107527 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230a4dd-f54d-45b6-a1c7-1a518d92a590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.107789 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230a4dd-f54d-45b6-a1c7-1a518d92a590 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.108476 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230a4dd-f54d-45b6-a1c7-1a518d92a590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.110417 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230a4dd-f54d-45b6-a1c7-1a518d92a590 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.138462 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1460/2897] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:59 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:59.144659 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fbb71-6196-4fc0-8a1e-217e1135ce6c admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.159735 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fbb71-6196-4fc0-8a1e-217e1135ce6c admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.218455 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe0dd9-faa5-4b4c-a65d-86b11061fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.219129 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0dd9-faa5-4b4c-a65d-86b11061fb7e admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.219405 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0dd9-faa5-4b4c-a65d-86b11061fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.219669 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0dd9-faa5-4b4c-a65d-86b11061fb7e admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.220351 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe0dd9-faa5-4b4c-a65d-86b11061fb7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.222334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe0dd9-faa5-4b4c-a65d-86b11061fb7e admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.243794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1438/2898] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:59 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:59.248143 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230a4dd-f54d-45b6-a1c7-1a518d92a590 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.258564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230a4dd-f54d-45b6-a1c7-1a518d92a590 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.263706 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba3f05-aeb6-4562-ac8d-26eb2d1d7817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.264376 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba3f05-aeb6-4562-ac8d-26eb2d1d7817 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.264662 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba3f05-aeb6-4562-ac8d-26eb2d1d7817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.264915 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba3f05-aeb6-4562-ac8d-26eb2d1d7817 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.265643 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba3f05-aeb6-4562-ac8d-26eb2d1d7817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.267304 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba3f05-aeb6-4562-ac8d-26eb2d1d7817 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.278062 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1461/2899] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:59.282195 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe0dd9-faa5-4b4c-a65d-86b11061fb7e admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.292369 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe0dd9-faa5-4b4c-a65d-86b11061fb7e admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.297524 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6af60-494b-47c7-ac33-b6756a1aa53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.298235 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6af60-494b-47c7-ac33-b6756a1aa53d admin admin] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.298514 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6af60-494b-47c7-ac33-b6756a1aa53d admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.298784 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6af60-494b-47c7-ac33-b6756a1aa53d admin admin] PATH_INFO: `/v3/roles` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.299513 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6af60-494b-47c7-ac33-b6756a1aa53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.301113 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6af60-494b-47c7-ac33-b6756a1aa53d admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.311403 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1439/2900] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:59.315631 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba3f05-aeb6-4562-ac8d-26eb2d1d7817 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.325747 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba3f05-aeb6-4562-ac8d-26eb2d1d7817 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.330681 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c759e0-0068-4596-bcb0-28874dffa223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.331564 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c759e0-0068-4596-bcb0-28874dffa223 admin admin] REQUEST_METHOD: `PUT` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.331843 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c759e0-0068-4596-bcb0-28874dffa223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.332118 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c759e0-0068-4596-bcb0-28874dffa223 admin admin] PATH_INFO: `/v3/projects/2b5f076819ae4d8a91d65bdd972dea44/users/10d459e60f834d769d8af41723dcedfe/roles/20d2df2c0f34477d842f0e792557bb47` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.346756 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c759e0-0068-4596-bcb0-28874dffa223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5f076819ae4d8a91d65bdd972dea44, user_id=10d459e60f834d769d8af41723dcedfe, role_id=20d2df2c0f34477d842f0e792557bb47)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.349396 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c759e0-0068-4596-bcb0-28874dffa223 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.365434 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1462/2901] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:59 2022] PUT /identity/v3/projects/2b5f076819ae4d8a91d65bdd972dea44/users/10d459e60f834d769d8af41723dcedfe/roles/20d2df2c0f34477d842f0e792557bb47 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:59.370797 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f8d5-6624-4906-8ed4-5e1275dd4db7 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.371084 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f8d5-6624-4906-8ed4-5e1275dd4db7 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.371359 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f8d5-6624-4906-8ed4-5e1275dd4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.390123 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-8205f8d5-6624-4906-8ed4-5e1275dd4db7 None None] MFA Rules not processed for user `90024dc2520a490e92255f559b6d8bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:59.391282 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-8205f8d5-6624-4906-8ed4-5e1275dd4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:59.456727 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1440/2902] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:59.467629 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c759e0-0068-4596-bcb0-28874dffa223 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.470298 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f4c759e0-0068-4596-bcb0-28874dffa223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:59.533156 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c759e0-0068-4596-bcb0-28874dffa223 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.537373 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5889f-ca8e-4e26-844a-9b35a937dd24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.537994 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5889f-ca8e-4e26-844a-9b35a937dd24 service neutron] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.538326 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5889f-ca8e-4e26-844a-9b35a937dd24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.538652 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5889f-ca8e-4e26-844a-9b35a937dd24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.548030 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5889f-ca8e-4e26-844a-9b35a937dd24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.549529 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5889f-ca8e-4e26-844a-9b35a937dd24 service neutron] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.559390 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1463/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:03.456745 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e50f-bb93-46e2-a005-f9f2f386eb22 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.457340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e50f-bb93-46e2-a005-f9f2f386eb22 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.457340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e50f-bb93-46e2-a005-f9f2f386eb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.485561 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-4ad6e50f-bb93-46e2-a005-f9f2f386eb22 None None] MFA Rules not processed for user `10d459e60f834d769d8af41723dcedfe`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:03.487214 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-4ad6e50f-bb93-46e2-a005-f9f2f386eb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:03.554401 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1441/2904] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:05:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:05:03.559074 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5889f-ca8e-4e26-844a-9b35a937dd24 service neutron] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.568745 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5889f-ca8e-4e26-844a-9b35a937dd24 service neutron] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:03.574028 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761784e-aa5a-4efc-b44d-69e3a3ca20a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:03.574993 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761784e-aa5a-4efc-b44d-69e3a3ca20a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.575273 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761784e-aa5a-4efc-b44d-69e3a3ca20a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.575547 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761784e-aa5a-4efc-b44d-69e3a3ca20a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.576366 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761784e-aa5a-4efc-b44d-69e3a3ca20a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:03.578337 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761784e-aa5a-4efc-b44d-69e3a3ca20a6 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:03.608933 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1464/2905] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Oct 28 20:05:03 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:05:03.610151 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6e50f-bb93-46e2-a005-f9f2f386eb22 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.621068 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6e50f-bb93-46e2-a005-f9f2f386eb22 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:03.682414 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff2188-a5a5-43a8-a946-83f753cbf5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:03.683103 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff2188-a5a5-43a8-a946-83f753cbf5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.683373 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff2188-a5a5-43a8-a946-83f753cbf5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.683643 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff2188-a5a5-43a8-a946-83f753cbf5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.684473 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff2188-a5a5-43a8-a946-83f753cbf5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:03.686436 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff2188-a5a5-43a8-a946-83f753cbf5b7 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:03.706696 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1442/2906] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Oct 28 20:05:03 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:05:03.710898 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761784e-aa5a-4efc-b44d-69e3a3ca20a6 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.721249 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761784e-aa5a-4efc-b44d-69e3a3ca20a6 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:03.725750 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157efe-419a-44f2-bb67-b6ece22b5c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:03.726497 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157efe-419a-44f2-bb67-b6ece22b5c83 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.726771 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157efe-419a-44f2-bb67-b6ece22b5c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.727039 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157efe-419a-44f2-bb67-b6ece22b5c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.727765 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157efe-419a-44f2-bb67-b6ece22b5c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:03.729366 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157efe-419a-44f2-bb67-b6ece22b5c83 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:03.740641 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1465/2907] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:05:03.744688 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff2188-a5a5-43a8-a946-83f753cbf5b7 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.754901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff2188-a5a5-43a8-a946-83f753cbf5b7 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:03.759622 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d0aa-d560-4caa-a9fc-abbd5dfd5706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:03.760538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d0aa-d560-4caa-a9fc-abbd5dfd5706 admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.760801 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d0aa-d560-4caa-a9fc-abbd5dfd5706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.761072 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d0aa-d560-4caa-a9fc-abbd5dfd5706 admin admin] PATH_INFO: `/v3/projects/588c308103bb476296600de317474a49/users/6891dc39440b4c8f9bc6365cd3968022/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.776973 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58d0aa-d560-4caa-a9fc-abbd5dfd5706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588c308103bb476296600de317474a49, user_id=6891dc39440b4c8f9bc6365cd3968022, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:03.779660 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58d0aa-d560-4caa-a9fc-abbd5dfd5706 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:03.793763 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1443/2908] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:03 2022] PUT /identity/v3/projects/588c308103bb476296600de317474a49/users/6891dc39440b4c8f9bc6365cd3968022/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:03.797930 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157efe-419a-44f2-bb67-b6ece22b5c83 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.808677 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157efe-419a-44f2-bb67-b6ece22b5c83 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:03.868400 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4eb16c-84bc-4f37-98ca-aec5876e7607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:03.869279 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eb16c-84bc-4f37-98ca-aec5876e7607 admin admin] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.869665 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eb16c-84bc-4f37-98ca-aec5876e7607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.870092 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eb16c-84bc-4f37-98ca-aec5876e7607 admin admin] PATH_INFO: `/v3/roles` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.870900 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4eb16c-84bc-4f37-98ca-aec5876e7607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:03.872630 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4eb16c-84bc-4f37-98ca-aec5876e7607 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:03.886253 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1466/2909] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:05:03.887655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d0aa-d560-4caa-a9fc-abbd5dfd5706 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.900498 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d0aa-d560-4caa-a9fc-abbd5dfd5706 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:03.905497 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e2045-2d7b-42c3-b3a8-2ed2fa93763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:03.906553 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e2045-2d7b-42c3-b3a8-2ed2fa93763b admin admin] REQUEST_METHOD: `PUT` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.906892 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e2045-2d7b-42c3-b3a8-2ed2fa93763b admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.907228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e2045-2d7b-42c3-b3a8-2ed2fa93763b admin admin] PATH_INFO: `/v3/projects/588c308103bb476296600de317474a49/users/6891dc39440b4c8f9bc6365cd3968022/roles/a8264e9fa2bc48e3a9d88793eecdf6f9` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.912910 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e2045-2d7b-42c3-b3a8-2ed2fa93763b admin admin] RBAC: Authorizing `identity:create_grant(project_id=588c308103bb476296600de317474a49, user_id=6891dc39440b4c8f9bc6365cd3968022, role_id=a8264e9fa2bc48e3a9d88793eecdf6f9)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:03.915794 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e2045-2d7b-42c3-b3a8-2ed2fa93763b admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:03.930243 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1444/2910] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:03 2022] PUT /identity/v3/projects/588c308103bb476296600de317474a49/users/6891dc39440b4c8f9bc6365cd3968022/roles/a8264e9fa2bc48e3a9d88793eecdf6f9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:08.528925 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b40ac-efd1-4dd4-84de-47944cc5d58f None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:08.529482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b40ac-efd1-4dd4-84de-47944cc5d58f None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:08.529577 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b40ac-efd1-4dd4-84de-47944cc5d58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:08.559461 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ae7b40ac-efd1-4dd4-84de-47944cc5d58f None None] MFA Rules not processed for user `6891dc39440b4c8f9bc6365cd3968022`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:08.560971 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ae7b40ac-efd1-4dd4-84de-47944cc5d58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:08.629780 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1467/2911] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:05:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:08.643968 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e2045-2d7b-42c3-b3a8-2ed2fa93763b admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:08.645982 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-a04e2045-2d7b-42c3-b3a8-2ed2fa93763b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:08.705028 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e2045-2d7b-42c3-b3a8-2ed2fa93763b admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:08.709371 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b07eb-5350-4596-acd3-468778704e82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f94515985e244af29f47a49c0dd415ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:08.710043 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b07eb-5350-4596-acd3-468778704e82 service glance] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:08.710361 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b07eb-5350-4596-acd3-468778704e82 service glance] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:08.710636 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b07eb-5350-4596-acd3-468778704e82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:08.768431 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b07eb-5350-4596-acd3-468778704e82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:08.769915 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b07eb-5350-4596-acd3-468778704e82 service glance] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:08.779374 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1445/2912] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:08.882987 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3181dd-df00-4db0-9037-59b750748ec0 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:08.883280 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3181dd-df00-4db0-9037-59b750748ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:08.883553 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3181dd-df00-4db0-9037-59b750748ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:08.902918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-ae3181dd-df00-4db0-9037-59b750748ec0 None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:08.904206 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-ae3181dd-df00-4db0-9037-59b750748ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:08.958759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1468/2913] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 20:05:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:09.007909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b07eb-5350-4596-acd3-468778704e82 service glance] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:09.009352 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-5d0b07eb-5350-4596-acd3-468778704e82 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:09.078231 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b07eb-5350-4596-acd3-468778704e82 service glance] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:09.084093 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54870-6ea5-4b53-b898-11bc7970404b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:09.084750 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54870-6ea5-4b53-b898-11bc7970404b service swift] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:09.085031 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54870-6ea5-4b53-b898-11bc7970404b service swift] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:09.085306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54870-6ea5-4b53-b898-11bc7970404b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:09.094655 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54870-6ea5-4b53-b898-11bc7970404b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:09.096266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54870-6ea5-4b53-b898-11bc7970404b service swift] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:09.104392 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1446/2914] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 20:05:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:05:17.472970 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ca76-917c-4215-a0e2-5f59c589af90 None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:17.473489 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ca76-917c-4215-a0e2-5f59c589af90 None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:17.473603 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ca76-917c-4215-a0e2-5f59c589af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:17.491899 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-89c9ca76-917c-4215-a0e2-5f59c589af90 None None] MFA Rules not processed for user `10d459e60f834d769d8af41723dcedfe`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:17.493095 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-89c9ca76-917c-4215-a0e2-5f59c589af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:17.500878 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1469/2915] 10.222.0.20 () {58 vars in 958 bytes} [Fri Oct 28 20:05:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:18.085350 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54870-6ea5-4b53-b898-11bc7970404b service swift] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:18.086930 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-42a54870-6ea5-4b53-b898-11bc7970404b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:18.165287 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54870-6ea5-4b53-b898-11bc7970404b service swift] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:18.171096 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91c3b7-5b39-43f9-a187-5c09feaae521 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:18.171748 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91c3b7-5b39-43f9-a187-5c09feaae521 service placement] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:18.172029 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91c3b7-5b39-43f9-a187-5c09feaae521 service placement] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:18.172342 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91c3b7-5b39-43f9-a187-5c09feaae521 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:18.174517 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-eb91c3b7-5b39-43f9-a187-5c09feaae521 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:18.186340 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91c3b7-5b39-43f9-a187-5c09feaae521 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:18.187909 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91c3b7-5b39-43f9-a187-5c09feaae521 service placement] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:18.197695 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1447/2916] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:19.383872 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69fd2b-7090-4109-b92f-fb33ab03de5c None None] REQUEST_METHOD: `POST` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:19.384367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69fd2b-7090-4109-b92f-fb33ab03de5c None None] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:19.384464 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69fd2b-7090-4109-b92f-fb33ab03de5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:19.412144 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.auth.core [None req-6c69fd2b-7090-4109-b92f-fb33ab03de5c None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91690) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:19.413315 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6c69fd2b-7090-4109-b92f-fb33ab03de5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:19.421121 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1470/2917] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Oct 28 20:05:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:19.433822 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91c3b7-5b39-43f9-a187-5c09feaae521 service placement] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:19.445894 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91c3b7-5b39-43f9-a187-5c09feaae521 service placement] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:19.451067 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68876c-8130-4f51-9a52-c56e0b56e3ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:19.451709 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68876c-8130-4f51-9a52-c56e0b56e3ff service swift] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:19.452016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68876c-8130-4f51-9a52-c56e0b56e3ff service swift] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:19.452281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68876c-8130-4f51-9a52-c56e0b56e3ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:19.460782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68876c-8130-4f51-9a52-c56e0b56e3ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:19.462406 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68876c-8130-4f51-9a52-c56e0b56e3ff service swift] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:19.470759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1448/2918] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 20:05:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:05:28.004325 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69fd2b-7090-4109-b92f-fb33ab03de5c None None] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:28.006667 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-6c69fd2b-7090-4109-b92f-fb33ab03de5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:28.090918 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69fd2b-7090-4109-b92f-fb33ab03de5c None None] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:28.098712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974b34e-b2ed-42ce-8fc5-78cb68e09185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:28.099389 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974b34e-b2ed-42ce-8fc5-78cb68e09185 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:28.099672 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974b34e-b2ed-42ce-8fc5-78cb68e09185 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:28.100015 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974b34e-b2ed-42ce-8fc5-78cb68e09185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:28.102194 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f974b34e-b2ed-42ce-8fc5-78cb68e09185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:28.114890 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974b34e-b2ed-42ce-8fc5-78cb68e09185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:28.116508 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974b34e-b2ed-42ce-8fc5-78cb68e09185 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:28.127551 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1471/2919] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:31.284281 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68876c-8130-4f51-9a52-c56e0b56e3ff service swift] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:31.306923 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68876c-8130-4f51-9a52-c56e0b56e3ff service swift] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:31.312866 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dfd28-2f9a-49ae-9a89-145e42d4a7d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:31.313519 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dfd28-2f9a-49ae-9a89-145e42d4a7d4 service placement] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:31.313800 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dfd28-2f9a-49ae-9a89-145e42d4a7d4 service placement] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:31.314061 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dfd28-2f9a-49ae-9a89-145e42d4a7d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:31.316006 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-724dfd28-2f9a-49ae-9a89-145e42d4a7d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:31.341593 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dfd28-2f9a-49ae-9a89-145e42d4a7d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:31.343334 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dfd28-2f9a-49ae-9a89-145e42d4a7d4 service placement] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:31.353306 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1449/2920] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:32.743874 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974b34e-b2ed-42ce-8fc5-78cb68e09185 service nova] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:32.745482 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f974b34e-b2ed-42ce-8fc5-78cb68e09185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:32.760238 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974b34e-b2ed-42ce-8fc5-78cb68e09185 service nova] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:32.765995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34ea07-feaf-44b2-ba54-333ac2cb1c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:32.766682 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ea07-feaf-44b2-ba54-333ac2cb1c43 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:32.766960 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ea07-feaf-44b2-ba54-333ac2cb1c43 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:32.767232 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ea07-feaf-44b2-ba54-333ac2cb1c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:32.769020 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-de34ea07-feaf-44b2-ba54-333ac2cb1c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:32.782169 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34ea07-feaf-44b2-ba54-333ac2cb1c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:32.783351 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34ea07-feaf-44b2-ba54-333ac2cb1c43 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:32.793974 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1472/2921] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:44.130951 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dfd28-2f9a-49ae-9a89-145e42d4a7d4 service placement] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:44.132623 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-724dfd28-2f9a-49ae-9a89-145e42d4a7d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:44.190452 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dfd28-2f9a-49ae-9a89-145e42d4a7d4 service placement] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:44.194845 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d476286-0203-43f7-b769-e1b04fc49488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '444a88451fbd4814b6d81023e68b54a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:44.195488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476286-0203-43f7-b769-e1b04fc49488 service neutron] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:44.195768 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476286-0203-43f7-b769-e1b04fc49488 service neutron] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:44.196044 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476286-0203-43f7-b769-e1b04fc49488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:44.205775 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d476286-0203-43f7-b769-e1b04fc49488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:44.207330 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d476286-0203-43f7-b769-e1b04fc49488 service neutron] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:44.216869 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1450/2922] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:46.042008 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34ea07-feaf-44b2-ba54-333ac2cb1c43 service nova] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:46.056303 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34ea07-feaf-44b2-ba54-333ac2cb1c43 service nova] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:46.063614 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b97f2-3bfe-4d18-a719-b09c52effbf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be7be85d70b64273b7904082ee2ba848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:46.064753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b97f2-3bfe-4d18-a719-b09c52effbf4 service nova] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:46.064753 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b97f2-3bfe-4d18-a719-b09c52effbf4 service nova] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:46.064975 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b97f2-3bfe-4d18-a719-b09c52effbf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:46.067010 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7b7b97f2-3bfe-4d18-a719-b09c52effbf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:46.081366 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b97f2-3bfe-4d18-a719-b09c52effbf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:46.083104 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b97f2-3bfe-4d18-a719-b09c52effbf4 service nova] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:46.095153 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1473/2923] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:07:07.605469 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7befe8a-ad91-4412-9275-fb5d85ba4055 None None] REQUEST_METHOD: `POST` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:07.606012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7befe8a-ad91-4412-9275-fb5d85ba4055 None None] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:07.606012 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7befe8a-ad91-4412-9275-fb5d85ba4055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:07.624782 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.auth.core [None req-b7befe8a-ad91-4412-9275-fb5d85ba4055 None None] MFA Rules not processed for user `c7fc75fab2e247ceaf897723c15023f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91691) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:07:07.626016 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b7befe8a-ad91-4412-9275-fb5d85ba4055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:07.636324 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1451/2924] 10.222.0.20 () {58 vars in 967 bytes} [Fri Oct 28 20:07:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:07:07.679576 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b97f2-3bfe-4d18-a719-b09c52effbf4 service nova] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:07.691956 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b97f2-3bfe-4d18-a719-b09c52effbf4 service nova] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:07.698190 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a571f4-2176-4916-842d-af79155c0407 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '720ff448eaea42aaa7e399e5b950b01e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:07.698828 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a571f4-2176-4916-842d-af79155c0407 service swift] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:07.699106 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a571f4-2176-4916-842d-af79155c0407 service swift] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:07.699377 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a571f4-2176-4916-842d-af79155c0407 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:07.707759 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a571f4-2176-4916-842d-af79155c0407 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:07.709321 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a571f4-2176-4916-842d-af79155c0407 service swift] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:07.717761 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1474/2925] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Oct 28 20:07:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:07:10.916108 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7befe8a-ad91-4412-9275-fb5d85ba4055 None None] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:10.917488 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-b7befe8a-ad91-4412-9275-fb5d85ba4055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:10.937102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7befe8a-ad91-4412-9275-fb5d85ba4055 None None] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:10.943088 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16887e19-2146-4b94-8c3b-774e8a2d1836 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:10.943707 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16887e19-2146-4b94-8c3b-774e8a2d1836 service placement] REQUEST_METHOD: `GET` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:10.944032 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16887e19-2146-4b94-8c3b-774e8a2d1836 service placement] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:10.944485 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16887e19-2146-4b94-8c3b-774e8a2d1836 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:10.946774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-16887e19-2146-4b94-8c3b-774e8a2d1836 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:10.960025 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16887e19-2146-4b94-8c3b-774e8a2d1836 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:10.961759 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16887e19-2146-4b94-8c3b-774e8a2d1836 service placement] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:10.981228 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1452/2926] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:07:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:07:14.147807 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a571f4-2176-4916-842d-af79155c0407 service swift] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:14.240716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a571f4-2176-4916-842d-af79155c0407 service swift] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:14.246678 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:14.247572 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:14.247853 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:14.248126 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] PATH_INFO: `/v3/users/10d459e60f834d769d8af41723dcedfe` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:14.249423 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d459e60f834d769d8af41723dcedfe)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:14.251573 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:14.302585 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d459e60f834d769d8af41723dcedfe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.314676 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d459e60f834d769d8af41723dcedfe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.315386 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d459e60f834d769d8af41723dcedfe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.315991 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d459e60f834d769d8af41723dcedfe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.324714 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d459e60f834d769d8af41723dcedfe'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.336883 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1475/2927] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:07:14 2022] DELETE /identity/v3/users/10d459e60f834d769d8af41723dcedfe => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:07:14.512705 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16887e19-2146-4b94-8c3b-774e8a2d1836 service placement] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:14.525271 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16887e19-2146-4b94-8c3b-774e8a2d1836 service placement] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:14.582109 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:14.582993 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:14.583266 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:14.583538 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] PATH_INFO: `/v3/projects/2b5f076819ae4d8a91d65bdd972dea44` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:14.584730 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5f076819ae4d8a91d65bdd972dea44)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:14.586687 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:14.632988 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5f076819ae4d8a91d65bdd972dea44', 'request_id': 'req-f3484baa-de2a-459e-813f-682a8722a198'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.638774 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5f076819ae4d8a91d65bdd972dea44', 'request_id': 'req-f3484baa-de2a-459e-813f-682a8722a198'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.647535 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5f076819ae4d8a91d65bdd972dea44', 'request_id': 'req-f3484baa-de2a-459e-813f-682a8722a198'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.658253 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] The token cache is being invalidate because project 2b5f076819ae4d8a91d65bdd972dea44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:07:14.658529 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.659254 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.660901 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1453/2928] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:07:14 2022] DELETE /identity/v3/projects/2b5f076819ae4d8a91d65bdd972dea44 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:07:14.665202 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:14.666927 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:14.681250 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58d1b-b03a-412a-bbed-d215ebf2d2f5 admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:14.737259 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:14.738139 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:14.738437 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:14.738716 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] PATH_INFO: `/v3/users/6891dc39440b4c8f9bc6365cd3968022` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:14.739895 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6891dc39440b4c8f9bc6365cd3968022)` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:14.741808 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:14.788176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6891dc39440b4c8f9bc6365cd3968022'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.800001 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6891dc39440b4c8f9bc6365cd3968022'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.800697 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6891dc39440b4c8f9bc6365cd3968022'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.801316 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6891dc39440b4c8f9bc6365cd3968022'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.809982 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.notifications [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6891dc39440b4c8f9bc6365cd3968022'} {{(pid=91690) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.821858 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1476/2929] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Oct 28 20:07:14 2022] DELETE /identity/v3/users/6891dc39440b4c8f9bc6365cd3968022 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:07:14.998424 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] Authenticating user token {{(pid=91691) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:14.999911 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.fernet_utils [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91691) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:15.013679 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3484baa-de2a-459e-813f-682a8722a198 admin admin] Validating token access rules against request {{(pid=91691) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:15.071512 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90024dc2520a490e92255f559b6d8bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62033cd74f1d4b33b3b42a6bdfc49f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91691) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:15.072397 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:15.072690 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:15.072957 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] PATH_INFO: `/v3/projects/588c308103bb476296600de317474a49` {{(pid=91691) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:15.074191 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=588c308103bb476296600de317474a49)` {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:15.076102 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] RBAC: Authorization granted {{(pid=91691) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:15.125206 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588c308103bb476296600de317474a49', 'request_id': 'req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:15.131714 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588c308103bb476296600de317474a49', 'request_id': 'req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:15.140518 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588c308103bb476296600de317474a49', 'request_id': 'req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40'} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:15.151341 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] The token cache is being invalidate because project 588c308103bb476296600de317474a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91691) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:07:15.151621 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:15.152250 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: DEBUG keystone.notifications [None req-b6a2cb9c-7fb3-4d12-8a60-afb8ddeafe40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91691) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:15.153920 dv-cinder-862894-1-iscsi devstack@keystone.service[91691]: [pid: 91691|app: 0|req: 1454/2930] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Oct 28 20:07:14 2022] DELETE /identity/v3/projects/588c308103bb476296600de317474a49 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:11:32.317367 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] Authenticating user token {{(pid=91690) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:11:32.319239 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:11:32.398197 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175ed49-e820-4500-a1a4-8a628c52422d admin admin] Validating token access rules against request {{(pid=91690) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:11:32.472061 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6631571-f613-4d23-baf4-2e4ad427873b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e04cc7f60894946aace79d4c2875f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e91226b635934bfcb949577491791af4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91690) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:11:32.472712 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631571-f613-4d23-baf4-2e4ad427873b service placement] REQUEST_METHOD: `GET` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:11:32.472995 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631571-f613-4d23-baf4-2e4ad427873b service placement] SCRIPT_NAME: `/identity` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:11:32.473264 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631571-f613-4d23-baf4-2e4ad427873b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91690) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:11:32.475176 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.fernet_utils [None req-c6631571-f613-4d23-baf4-2e4ad427873b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91690) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:11:32.486626 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6631571-f613-4d23-baf4-2e4ad427873b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:11:32.488205 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6631571-f613-4d23-baf4-2e4ad427873b service placement] RBAC: Authorization granted {{(pid=91690) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:11:32.497977 dv-cinder-862894-1-iscsi devstack@keystone.service[91690]: [pid: 91690|app: 0|req: 1477/2931] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Oct 28 20:11:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)